Powered by
Simultaneous AI queries
# ❓|questions
r
roneyal
10/23/2023, 10:07 PM
Is it possible to have the provider AI queries be executed in parallel?
i
ian
10/23/2023, 11:06 PM
yep, they are executed in parallel by default - up to 4 at a time. Maximum concurrency can be set from the CLI using the the
-j
param:
promptfoo eval -j 4
You can also include it in the config file with
evaluateOptions.maxConcurrency
r
roneyal
11/06/2023, 9:56 PM
Thanks,
@ian
!
Previous
Next