https://promptfoo.dev/ logo
Automatic trace injection to promptfoo from coding...
# ❓|questions
p
Aye, I was wondering if there is any automagical way to send to promptfoo traces or conversations that I have with the likes of Codex, Claude Code, Amp or some other coding assistants that use subscription model instead of and API. Something that would listen real time and make it go to promptfoo for me to evaluate on each turn basis? Maybe some third party tool? Thanks
d
👋 Hey, we recently added a [Claude Agent SDK](https://www.promptfoo.dev/docs/providers/claude-agent-sdk/) provider which could potentially help for doing this with Claude Code (the agent sdk is basically Claude Code in sdk form). But I think we’ll need to do some more work to make the intermediate outputs traceable. We’d like to add providers for other coding agents as well… we’ll keep this usecase in mind!