Is it possible to change the delay length depending on the provider? I'm testing different models, some of which have much stricter rate limits, but i don't want to slow all requests down with setting ---delay globally. Thank you!
i
ian
04/22/2024, 10:17 PM
Hey @mikelacher, not currently supported, but https://github.com/promptfoo/promptfoo/pull/699 adds this functionality to set a delay for a specific provider. It will be in the next published release 🙂
m
mikelacher
04/23/2024, 2:45 PM
thank you! that's awesome. any idea when the next release might get published? thanks for your work on this tool. it's hugely useful.