https://promptfoo.dev/ logo
Using red team generated prompts and my own custom...
# questions
d
Hi, I'm trying to understand how to use the generated
{{prompt}}
and then add my own prompts. I did try this:
Copy code
prompts:
  - '{{prompt}}'
  - 'My custom prompt'
But then when I view the output, it's not showing my prompt as another entry in the list - it's appending it to each prompt that was generated. What am I not getting about this?
w
Can you share your full config?
d
Copy code
description: My custom redteam smoketest
targets: file://targets/agent_http.yaml
prompts:
  - '{{prompt}}'
  - 'My custom prompt'
providers:
  - id: vertex:gemini-2.0-flash-lite
redteam:
  purpose: file://agents/agent.yaml
  plugins:
  - id: 'toxic-chat'
    numTests: 5
  strategies:
  - id: base64
  - id: jailbreak
extensions:
  - file://extensions/ai_infra_create_session.py:extension_hook
when I run
promptfoo view
, I am expecting `My custom prompt' to be a row, but instead, it's a column and that's confusing to me
should I be creating custom tests instead of prompts?
Ok, so it looks like I can add my own test cases to the generated promptfoo yaml file. So I guess the Q now is: is that the right way to do this?
u
@dulax1 probably not- I recommend you check out https://www.promptfoo.dev/docs/red-team/plugins/intent/
d
Ok. I just found that today. Thank you