Hi ! 😄
I'm using for multi-agents system testing and I'd like to know if there are any project using Promptfoo extensively so that I can better understand how to structure the directory/file structure.
In my case I have :
- agents/
- api-agent/
- api-agent.yml # where i define the prompts (ref to a file) / providers (i'd like to store them in files) / tests (ref to test files)
- tests-use-case-XXX-api-call.yml # where i define the tests as well as the assertion (with templates if possible)
Is there any way to reference "api-agent.yml", and all other file like it, in the config.yml ?
Is it the right way to do it ?
How to manage multiple providers used across multiple files (uncreative-phi3 with temp=0.0, and creative-phi3 with temp=1.0) that needs to be compared across the whole tests.
Any advice or discussion is welcome 🙂