I'd love to bring this on our radar again. I've be...
# proj-agent
c
I'd love to bring this on our radar again. I've been keeping an eye on this one for a while, but I don't know if Bend2 works or can work. I do think who can figure out formal verification in some usable way will be leading cc: @wide-doctor-37830 would absolutely love your thoughts on any of this or related things https://x.com/VictorTaelin/status/2025582923479466134?s=20
w
IMO you'd get 80% of the benefit of formal verification just by using a strongly typed compiled language like Go, Rust, or Java
The big bottleneck is the amount of training data for the langauge. So I imagine e.g. Bend is not a great experience
I've been beating the drum for Go for a while, but tbh the agent still seems better at python
c
I heard good things about Rust in particular, on this
In what ways does the agent seem worse in Go?
w
i'm mostly basing that on vibes 🙂
I haven't done a ton of Go w/ agents though, and the newer models might be better
I don't think the numbers in https://multi-swe-bench.github.io/#/ are super comparable across languages, but you can see a big difference there