https://promptfoo.dev/ logo
GPT-4o-mini can't be used as a grader
# ❓|questions
l
I'm facing two problems: 1. When trying to include --grader openai:gpt-4o-mini at the end of my eval, I get a message saying that it can't be used to evaluate. Why is that? 2. When trying to include it before doing "redteam run", I also get an error saying it's not a good command. Why can't I tell which grader I want when running run. Isn't it going to run eval after anyway?
i
1. strange, do you have the full error message/screenshot? 2. probably easiest to put it directly in the config. The
--grader
option is not supported by all commands
Copy code
yaml
defaultTest:
  options:
    provider: openai:gpt-4o-mini
l
Will try this and report back, thank you!
i
sounds good let me know!