https://promptfoo.dev/ logo
How to view failures in CLI output?
# ❓|questions
d
Loving promptfoo, thank you! I'm using it to quickly iterate on a "checking" prompt, where the LLM is just return "VALID or "INVALID" depending on the prompt. I have a long list of prompts I'm feeding in to check against, if any towards the bottom fail, I cannot see which particular prompts failure because the table rows get truncated in the CLI output. Is it possible to filter the table to only show failures?
i
Yup, the web UI has a "Show failures only" mode. LMK if that works for you!
d
Thanks, I haven't tried the web UI yet so I'll take a look
Would be nice to have it in the CLI too though, so I can do all my work from the terminal
Ok this isn't too bad, I'm running the CLI in watch mode so I just save the file and then switch to browser which autoreloads, noice!
i
hmm - would not be too bad to add an option to filter the CLI table. but glad the webui is working nicely for you
4 Views