I made the changes and not getting any error now...however i want to ensure my understanding of "promptfoo red team" command is correct.
My promptfooconfig.yaml config is as mentioned below.
The apiKey set here is generated from Openweb UI which is locally hosting mistral.
targets:
- id: openai:chat:mistral:latest
config:
apiBaseUrl:
http://localhost:3000/api
apiKey: 'sk-3728ca66f0dd4425bfeaa3-------'
temperature: 0.5
In environment variable i have set OPENAI_API_KEY to the paid API key from OpenAI web console.
Based on attached "promptfoo redteam run --verbose" output i can understand...
1. On running this command it first generates requests towards api.promptfoo.org to generate harmful prompts.
2. It then sends these prompts to locally hosted mistral via API hosted on OpenwebUI.
3. The response received from above prompts are graded.
For grading the prompts are sent to gpt40.
For grading to work an active OpenAI API key is required and set in environment variables.
@ian Would request you to go through attached output and confirm if i was actually able to test the locally hosted mistral using promptfoo and my above understanding of "promptfoo redteam run" is correct.
https://cdn.discordapp.com/attachments/1358033855214518384/1359079245380587601/Verbose_output.txt?ex=67f62cae&is=67f4db2e&hm=b2dfde8626103cb76610baad44bb4524a45a675a40086328923b050dee946bf0&