Hey everyone, I've added support for experiment config files in my PR so that we can compose rewards, tools, and prompts with YAML files like this. This builds on top of @adventurous-tiger-32098’s work on the reward registry by adding a tool registry. This allows us to use the default openhands tools along with custom tools and toolsets. Lmk if folks have thoughts on this in the PR: https://github.com/OpenHands/agentic-code-search-oss/pull/40 Here's an example config file:

name: "read_only_tools"
description: "The agent only has access to read only tools"

reward:
  - fn: tool_use_reward
  - fn: turn_efficiency

tools:
  - glob
  - grep
  - terminal

prompts:
  system_prompt: "templates/system_prompt.j2"
  user_prompt: "templates/file_localization.j2"

Nice. Took a first pass it looks pretty good. Will take a more thorough review tonight.

Thanks!