https://promptfoo.dev/ logo
Http API provider is working for generations but N...
# ❓|questions
r
Promptfoo uses by default open ai model for evaluations. How HTTP API provider can be forced to use for evaluations also? Can someone please tell if they have tried it? https://cdn.discordapp.com/attachments/1373902607906508862/1373902608426598400/image.png?ex=682c1a03&is=682ac883&hm=5b0077cc38b5105840aab8948244eaf93117e77d3f53d53fd1d4bdc20b598dd1&
b
Hi, have you tried using the example https://github.com/promptfoo/promptfoo/blob/main/examples/http-provider/promptfooconfig.yaml. in order for me to help you use the api provider i will have to know more about your endpoint to advise.
r
please try to run promptfoo eval --verbose command. You will see in the terminal that promptfoo is using Http provider for generation and openai provider (by default some openai model) for evaluation.
b
Are you using a red team configuration? Or just plain evaluation?
r
Plain evaluation
i