Hi Graham sir! Regarding this issue: I have completed Sonnet-4.5 evaluations. Unless we want to evaluate additional closed-source LLMs, we may want to close the issue. On SWE-Bench Verified, using our simple bash-only scaffold with Sonnet-4.5 is an order of magnitude better than RepoNavigator (which uses the

jump

tool) with +18 points absolute improvement in function-level F1 scores. I feel it may be worth trying out our scaffold + Claude-3.5-Sonnet on SWE-Bench Lite because it maybe comparable to LocAgent looking at the superior performance of GPT-5+our scaffold. But the Neulab litellm proxy doesn't have this model. (this is optional though)

Nice, I think those two are good enough!

Ok sir, thanks!