https://promptfoo.dev/ logo
Pricing associated with tests and asserts
# ❓|questions
i
I imagine the pricing associated to testing a model is based on your own pricing of the model key you provide. However, if I run a promptfooconfig.yaml with multiple tests, each of which have multiple asserts, does the model call trigger at each assert, or at each test? Or does it only trigger once when running?
i
The model call runs for each test, and all asserts are run on the same output. So it should just trigger once
also, it will cache automatically (for most providers) so subsequent evals with the same call don't cost anything