I want to move the image building logic in the end-to-end evaluation framework from K8s to GithubActions. No more polling in K8s, logic now at higher level in github actions, remove 430 lines of hacky orchestration code • evaluation https://github.com/OpenHands/evaluation/pull/471 • benchmarks https://github.com/OpenHands/benchmarks/pull/666 This would work except that the

GITHUB_TOKEN

that is now used to log in GHCR is now from the

evaluation

repository, no the

benchmarks

repository. Could someone add the evalution repo to the GHCR package's access list? Agent:

For each package (eval-builder and eval-agent-server):

  1. Go to <https://github.com/orgs/OpenHands/packages/container/eval-builder/settings>
  2. Scroll to Manage Actions access
  3. Click Add Repository
  4. Search for OpenHands/evaluation
  5. Set role to Write

  Then repeat for <https://github.com/orgs/OpenHands/packages/container/eval-agent-server/settings>

done!

awesome! let me try again 🙂

try again

Did you also grant access to

eval-agent-server

? I think it's still on read! Oh and if you could also give write access for eval-base... @chilly-france-44439 https://github.com/orgs/OpenHands/packages/container/eval-base/settings

you shoul dnow have write access for eval base

thanks!!