Our failure rate for the code review bot is very h...
# proj-automation
l
Our failure rate for the code review bot is very high (probably due to 10-minute time outs) which is making it hard to rely on it for reviews…
➕ 1
It seems that there were problems with managed API keys expiring or going bad. Here’s a description of the problem and a couple PRs that could potentially fix it: • https://github.com/OpenHands/OpenHands/issues/15022 • https://github.com/OpenHands/OpenHands/pull/15023 • https://github.com/OpenHands/OpenHands/pull/15024 @quick-window-91705 or @straight-sundown-84319 would either of you be able to take a look? I’m not very familiar with how the key issuance stuff works and I’m not sure if these are appropriate fixes…
q
Will look into this soon-ish if time permits Meanwhile is there a workaround to get the code review up in prod at least
l
I guess maybe manually modify the database
Because the all-hands-bot’s API key is invalid and AFAIK there’s no way to renew it. The first PR creates an endpoint making it possible to renew the key, so if we did the same procedure manually then we could probably fix the issue
👍 1
q
SG I can bump priority on this, patching the fix seems nicer
🙏 1
Also a question regarding whether we need to store litellm keys in our DB, I'm not sure about the historical context behind this: github.com/OpenHands/OpenHands/pull/15024/changes#…
l
Hey @quick-window-91705, thanks for picking this up. I think @helpful-quill-73496 was wondering if auto-review was working so I just thought I’d ask about the current situation
q
Still not working, I meant to get this fix tested and merged but we've had problems with our staging deployment delaying the process
l
Got it, thanks for the update!
Hey @quick-window-91705, it’d be good to get this finished so we can get back to auto-reviewing, let’s schedule some time for that on this cycle: OSS-5709: Fix review bot
q
Ah right lost track of this, working on this first
🙏 1
github.com/OpenHands/OpenHands/pull/15023 - merged the fix, requires a release
🙏 1
l
Awesome, thanks!