Integrate pytest-shard
pytest-shard looks like a good solution for reliable parallelization in CI.
Granted, we'd take the startup overhead for each job, but we wouldn't have the caveats of pytest-parallel (storming the sidekiq workers, frequent deadlock at the end of the run).