Is there a way to shard tests (by maybe passing a shard key)? My agent right now is stateful so I setup a sandbox with a setup and teardown but I have to limit concurrency quite a bit cause of memory constraints. I can split up tests and run on completely different machines but was wondering if there was an easier way than explicitly defining which groups tests belong in

Hi @azai91 - we don't have any native sharding capability right now, but that's a great idea that I can bring up with the team. Currently I'd recommend essentially what you suggested, split your test cases up into multiple configurations and run each one on a separate machine. fwiw claude or codex could probably one-shot a little helper script to split them up automatically 🙂