https://promptfoo.dev/ logo
Multiples test.json and multiples Providers
# ❓|questions
h
Hello everyone, how are you? How can I call more than one tests in a json file? Example: test.json test2.json in the same YAML. It is possible?
tests: - name: Test1 file: teste2.json assert: - type: answer-relevance threshold: 0.8 - type: not-icontains-any value: - 'context provided' - 'contexto fornecido' - name: Test2 file: tests.json assert: - type: answer-relevance threshold: 0.8
i
you should be able to do something like:
Copy code
yaml
tests:
  - file://test1.json
  - file://test2.json
h
thanks for responding @ian . One question, can I use 2 providers calling 2 different tests? Example: Provider1 - tests1.json Provider2 - tests2.json
i
nope, for that I would just separate the test configs
(you can run multiple configs at the same time with
promptfoo eval -c config1.yaml config2.yaml
)
h
hummmm ok, tks brow.
2 Views