https://www.boundaryml.com logo
maintaining promptfoo tests
# general
s
Hi guys, I've been experimenting with BAML - really enjoy it from a dev experience standpoint. I'm would like to integrate it into our project for prompt development. The one hurdle I am hitting is that we have a suite of promptfoo tests that we would like to maintain. I was looking for a way to take the .baml files and convert them into prompt messages, similar to the baml playground. If this was possible I'm thinking the output from that could be used to keep the promptfoo suite of tests running. Any suggestions on how to do that? I was looking for an optoin using the cli but didn't find anything.
b
Does the [modular API](https://docs.boundaryml.com/guide/baml-advanced/modular-api) give you what you want?
Oh, promptfoo tests are YAML files? Hmm...
Copy code
Wildcards like path/to/prompts/**/*.py:func_name are also supported.
OK, so I think that works, if you write python or TS code to bridge the promptfoo tests
(I'm guessing that "I was looking for an option using the CLI" was trying to figure out how to generate promptfoo files from .baml files)
Let me know if this makes sense, I'm not confident I'm interpreting your question correctly
2 Views