Finished the whole SWE-bench Lite dataset now. Ended on 17% solved issues (about $22 spent)
gifted-airport-65416
04/05/2024, 11:25 AM
Here's the generated patches if someone's interested
gifted-airport-65416
04/05/2024, 11:37 AM
I generate reports in Markdown for each run also, like the attached example. This showing each step in my "agent pipeline". This isn't really ready to be published yet... But if you're interested you can DM me and I'll send the report bundle.