https://promptfoo.dev/ logo
Help regarding getting Base64 Image final prompt a...
# ❓|questions
u
Hi! I am performing testing on an LLM in dev env with the following:
Copy code
plugins:
 - id: debug-access  # Tests for exposed debugging interfaces and commands
  strategies:
    - id: basic  # Original plugin tests without any additional strategies or optimizations
    - id: jailbreak:composite  # Combines multiple jailbreak techniques for enhanced effectiveness
    - id: jailbreak:likert  # Uses Likert scale-based prompts to bypass content filters
    - id: jailbreak  # Single-shot optimization of safety bypass techniques
~~Saw a "Fail" case that made use of Base64 encoded image as shown in the uploaded picture. Would like to check if it is possible to get the final prompt sent to the LLM or how this prompt is created. Also unsure if the prompt was generated under DebugAccess or by a strategy. Any help or advice on where to check is greatly appreciated. Thank you!~~ *Edit: * Realised the UI interprets the prompt as a base64 image because of the following line in the ResultsTable.tsx
Copy code
if (
       typeof value === 'string' &&
        (value.match(/^data:(image\/[a-z]+|application\/octet-stream);base64,/) ||
         value.match(/^\/[0-9A-Za-z+/]{4}.*/))
)
Still unsure about the actual prompt being sent out, as manually using the prompt listed in the image gets a PASS response. https://cdn.discordapp.com/attachments/1385158186046324829/1385158186494984294/base64_fail.PNG?ex=68565e16&is=68550c96&hm=970229f01b0872c18132009b9e4e8014b90515de8f2aaa8fb687b76892458fb4&
i
huh interesting. can you see the prompt if you hover over the fail cell and click the 🔍 icon?
i
u
Awesome, thanks!