manu3b
03/12/2024, 3:14 PMpromptfoo generate dataset -o tests.yaml
The tests.yaml content is:
tests:
- vars:
topic: >-
What's the best route from New York to San Francisco for a road trip
avoiding highways?
- vars:
topic: >-
How do you handle a situation where your autonomous car's navigation
system fails in the middle of a road trip?
But this tests.yaml can not be included in a config.yaml with any usual way like:
prompts: prompts.txt
providers: openai:gpt-3.5-turbo
...
# Load & runs all test cases matching these filepaths
tests:
# You can supply an exact filepath
- tests/tests.yaml
# Or a glob (wildcard)
- tests/*
# or
- file://tests.yaml
#or
tests: tests.yaml
#or
file://tests.yaml
I need to remove the first "tests:" indentation and keep only "vars:"
- vars:
topic: >-
What's the best route from New York to San Francisco for a road trip
avoiding highways?
- vars:
topic: >-
How do you handle a situation where your autonomous car's navigation
system fails in the middle of a road trip?
Anything I missed?ian
03/12/2024, 4:56 PM