m0ltz
12/29/2023, 2:00 PMeval does accept --config flag, but it's not clear if it points to the promptfooconfig.* file or a dir containing that.
Then what about the view command? It has the directory positional parameter, but not clear what this directory is.
Or am I supposed to create a separate npm package for each set of prompt use cases?ian
12/30/2023, 11:29 PMpromptfoo eval -c usecase1.yaml
and
promptfoo eval -c usecase2.yaml
etc.
You can point to a dir containing multiple configs, but that will run them all in a single eval, which isn't what you want.ian
12/30/2023, 11:30 PMpromptfoo view, this starts a web server that serves the latest results. Unless you have altered the location of the promptfoo results directory, you don't need to pass a directory.