https://promptfoo.dev/ logo
Comparing similarity of two system prompts across ...
# ❓|questions
t
I am looking to compare output of a 'base' prompt and a 'contender' prompt across 100s, perhaps 1000s of different user inputs. I want to compare the contender outputs with the base output - how do I best do that? THANKS A BUNCH
i
Hey @tobiastroelsen, you should set up the "Base Prompt" and "Contender Prompt" as prompts, and each of the 100s or 1000s of user inputs as test cases. I'd start with the guide here: https://promptfoo.dev/docs/configuration/guide Let me know if you have any questions about starting!