https://promptfoo.dev/ logo
Assert with 'llm-rubric' leads to "OpenAI API Key ...
# ❓|questions
d
Hello, i tried to use promptfoo with the llm-rubric assert without success. I am using the latest docker image of promptfoo and I set the environment variables to use OpenAI:
Copy code
env:
  OPENAI_API_KEY: sk-proj-XXXXXXXXXX
  OPENAI_API_HOST: api.openai.com
  OPENAI_ORGANIZATION: org-XXXXXXXXXX
When i don't use the llm-rubric assert everything works fine. The llm is generating a response to my prompt which is visible in the result. But with the llm-rubric assert i only get an error. Even when i set apiKey in the providerconfig of the config.yaml https://cdn.discordapp.com/attachments/1257960702099066911/1257960702363177082/image.png?ex=66864eb3&is=6684fd33&hm=9151f4f84015aad08ac44813c0cb75ef8174e28784615cd57f510ce21a6e261c&
i
hello, you'd have to override the provider for the assertion separately to include the api key: