Getting codex CLI to work inside PR Review workflo...
# proj-extensions
c
🙌 2
appreciate reviews from ACP expert cc @strong-ice-84145
👀 1
l
It'd be very interesting to A-B test this
c
yeah, we first need a codex subscription, then a way to A/B test 😄
l
I think we have one through our openhands chatgpt accounts?
or if you don't then I can add you to the org
c
yeah, but then we still need a way to A/B test these actions
l
a/b testing is already mostly supported, you just put two LLMs comma-separated
(we literally could turn it on today by changing the LLM name)
c
ha, i was actually thinking about workflow-level A/B testing, eg randomly trigger one of the gh action step - that way we can have ab test support ACP mode also
l
yep, laminar can store metadata, so we just need to store whatever metadata about what approach is used
s
> yeah, we first need a codex subscription, then a way to A/B test 😄 @chilly-france-44439 you can also authenticate via API key directly too if you need! LGTM for the PR! Maybe its also worth documenting the API key authentication method in the README.md?
🙌 1