https://promptfoo.dev/ logo
Any big project using promptfoo existing ?
# ❓|questions
n
Hi ! 😄 I'm using for multi-agents system testing and I'd like to know if there are any project using Promptfoo extensively so that I can better understand how to structure the directory/file structure. In my case I have : - agents/ - api-agent/ - api-agent.yml # where i define the prompts (ref to a file) / providers (i'd like to store them in files) / tests (ref to test files) - tests-use-case-XXX-api-call.yml # where i define the tests as well as the assertion (with templates if possible) Is there any way to reference "api-agent.yml", and all other file like it, in the config.yml ? Is it the right way to do it ? How to manage multiple providers used across multiple files (uncreative-phi3 with temp=0.0, and creative-phi3 with temp=1.0) that needs to be compared across the whole tests. Any advice or discussion is welcome 🙂
2 Views