hello, I have a redteam.yaml file with a bunch of plugins enabled, is it possible to just generate prompts, and save them in a file based on all plugins enabled? can I do it local only and even with openai key?

Yes, you can generate them using the

redeteam generate

command. These plugins are remote only:

Complete List of Remote-Only Plugins

  These plugins absolutely require Promptfoo Cloud (remote generation) and will return empty
  arrays if PROMPTFOO_DISABLE_REDTEAM_REMOTE_GENERATION=true is set:

  1. Unaligned Harmful Content Plugins (22 total)

  From UNALIGNED_PROVIDER_HARM_PLUGINS (lines 203-220):
  - harmful:child-exploitation
  - harmful:hate
  - harmful:indiscriminate-weapons
  - harmful:non-violent-crime
  - harmful:self-harm
  - harmful:sex-crime
  - harmful:sexual-content
  - harmful:violent-crime
  - harmful:chemical-biological-weapons
  - harmful:copyright-violations
  - harmful:cybercrime
  - harmful:cybercrime:malicious-code
  - harmful:graphic-content
  - harmful:harassment-bullying
  - harmful:illegal-activities
  - harmful:illegal-drugs
  - harmful:illegal-drugs:meth
  - harmful:insults
  - harmful:profanity
  - harmful:radicalization
  - harmful:unsafe-practices
  - harmful:weapons:ied

  2. Bias Plugins (4 total)

  From biasPlugins (lines 254-277):
  - bias:age
  - bias:disability
  - bias:gender
  - bias:race

  3. Remote-Only Plugins (33 total)

  From remotePlugins array (lines 316-362):
  - agentic:memory-poisoning
  - ascii-smuggling
  - bfla
  - bola
  - cca
  - competitors
  - harmful:misinformation-disinformation
  - harmful:specialized-advice
  - hijacking
  - indirect-prompt-injection
  - mcp
  - off-topic
  - rag-document-exfiltration
  - rag-poisoning
  - reasoning-dos
  - religion
  - special-token-injection
  - ssrf
  - system-prompt-override

  Medical Plugins (6 total):

  - medical:anchoring-bias
  - medical:hallucination
  - medical:incorrect-knowledge
  - medical:off-label-use
  - medical:prioritization-error
  - medical:sycophancy

  Financial Plugins (10 total):

  - financial:calculation-error
  - financial:compliance-violation
  - financial:confidential-disclosure
  - financial:counterfactual
  - financial:data-leakage
  - financial:defamation
  - financial:hallucination
  - financial:impartiality
  - financial:misconduct
  - financial:sycophancy

  ---
  Total: 59 Remote-Only Plugins

oh ok, and to use them I need my own openai key or it is possible also without?

These require access to our api to generate. You can use your own api key to generate tests for the other plugins not on this list.