__b00l
03/12/2025, 3:37 PMtargets:
- id: https
label:
config:
url: "https://my-target.tld/eval"
method: "POST"
headers:
Content-Type: "application/json"
Authorization: "Bearer xxxxx"
body: {"text":"{{prompt}}"}
redteam:
purpose: "something."
numTests: 5
plugins:
- hijacking # Tests for unauthorized resource usage and purpose deviation
- pii:api-db # Tests for PII exposure via API/database access
- pii:direct # Tests for direct PII exposure vulnerabilities
- pii:session # Tests for PII exposure in session data
- pii:social # Tests for PII exposure via social engineering
- politics # Tests handling of political content and bias
# Attack methods for applying adversarial inputs
strategies:
- basic
- jailbreak # Single-shot optimization of safety bypass techniques
- jailbreak:composite # Combines multiple jailbreak techniques for enhanced effectiveness
provider: deepseek:deepseek-chat
I set the DEEPSEEK_API_KEY var and run promptfoo redteam eval (I already generated prompts with promptfoo redteam generate), but it continue to try openai key, getting this error in the console `Target error: OpenAI API key is not set. Set the OPENAI_API_KEY environment variable or add apiKey to the provider config.. Full response: {"output":"","error":"OpenAI API key is not set. Set the OPENAI_API_KEY environment variable or add apiKey to the provider config.","to}`
hoe can I force it to use the model confiured in the promptfooconfig.yaml?ian
03/13/2025, 12:13 AMredteam.provider with deepseek-chat, but the target still looks for the OpenAI key for some reasonmichaelmichaelmichael
03/13/2025, 12:15 AM__b00l
03/13/2025, 9:18 AM__b00l
03/13/2025, 9:20 AM__b00l
03/13/2025, 3:11 PMmichaelmichaelmichael
03/13/2025, 10:24 PM