<https://x.com/togethercompute/status/202673806137...
# random
b
https://x.com/togethercompute/status/2026738061376368879 useful dataset for training on SWE Bench styled tasks. It uses OpenHands as the scaffold
l
yeah, although I think it's filtered from existing datasets, similar to our ADP data, right?
b
Yes, they do not curate new GitHub issues to be fair. But I think they curated the trajectories themselves using the Qwen3 Coder 480B variant. Basically this is just SWE Gym on steroids (not any method novelty). Also, I am somewhat concerned that they did not filter the repositories from SWE Bench Verified, but (repo, commit) tuples and issue descriptions: https://x.com/togethercompute/status/2026738066321453408. So it may have happened that they trained on the same repo but from a different commit id if they were not careful enough
l
oh, interesting
b
From what I remember, the R2E Gym unfiltered variant did have SWE Bench repositories. Training on the same repo is definitely cheating - I can check tomorrow/in the weekend and get back to you
🙏 1