https://promptfoo.dev/ logo
Tracking tokens per second?
# ❓|questions
w
Would love to get tokens per second listed as a metric for each prompt that is tested. We're testing prompts x models x providers all at once sometimes and it's a nice way to evaluate which provider is giving us the best speeds
i
you can force it to ignore the cache with
promptfoo eval --no-cache
w
ooh yeah this is exactly what i was hoping for
thank you!