Remove openhands index runs as a release requireme...
# proj-agentl
limited-student-10747
07/29/2026, 12:18 PMRemove openhands index runs as a release requirement: github.com/OpenHands/software-agent-sdk/pull/4302
✅ 1
c
calm-artist-7206
07/29/2026, 12:28 PMShould I understand this as a complete change, such as, even things directly affecting the performance of the OH agent are not of interest anymore?
calm-artist-7206
07/29/2026, 12:28 PMI mean, there’s a case to be made that maybe eval requirement went a bit deep “just in case” in the reviewer and implementor agents’ prompt
calm-artist-7206
07/29/2026, 12:30 PMso, it seems to me, there’s a difference between toning it down, and removing it even on PRs that do present a high risk of affecting performance
l
limited-student-10747
07/29/2026, 12:46 PMBasically, it’s too heavy of a requirement for releases. Blocking release on it would mean that we’d have to wait 3-5 days before every release. We’ll still be evaluating periodically
c
calm-artist-7206
07/29/2026, 1:03 PMOK, do we still want to eval a potentially risky PR?
l
limited-student-10747
07/29/2026, 1:14 PMit’s a good idea but probably not the whole index unless it’s a huge change
c
calm-artist-7206
07/29/2026, 1:21 PMAh yes, it would be the whole index… fair enough! OK, I’m reading this as, still a concern but we can probably live with some arguable misses and deal with it later if we have to
l
limited-student-10747
07/29/2026, 1:22 PMYep!
👍 1
2 Views