Running promptfoo.yaml with no prompts, only provi...
# questionsw
Waz
08/11/2025, 10:57 PMMy custom provider is being used to test a multi-agent system and evaluate outputs. Is it possible to use promptfoo.yaml but omit prompts entirely from the file? As my agent handles prompts directly
u
[Promptfoo] Steve
08/12/2025, 4:08 AM@Waz what do mean it handles prompts directly?
w
Waz
08/12/2025, 9:03 AMAs in my custom provider utilises multiple hardcoded internal prompts
Waz
08/12/2025, 9:05 AMPreviously I modified the provider in order to accept the system prompt being passed in via promptfoo, and to use that, however now that this system uses multiple agents, it means the system prompt can switch mid-flow, so it's getting much harder to pass it in via promptfoo
Waz
08/12/2025, 9:33 AMLast I tried, running an eval without a prompts array causes an error. Is there a correct way to handle this?
w
Will [Promptfoo]
08/12/2025, 5:28 PMhi @Waz , I can hop on a quick call and help you debug this if you would like – https://cal.com/promptfoo-will/15min