https://promptfoo.dev/ logo
how to use similar assertion in test.csv file
# ❓|questions
v
Dear Team, I want to do the similarity test . my test cases and assertions are in tests.csv file. as below in this for similarity test how to specify the threshold value? for icontains also can you suggest what is right approach to provide multiple selection. it seems via test.csv file it is not able to perform icontains-any correctly. Note: when I am doing similar assertion, in assertion part I can see it is saying equals in promptfoo GUI while it should be similar right? unlike llm-rubric or icontains-any assertion it is showing llm-rubric and icontains-any etc... thanks a lot in advance https://cdn.discordapp.com/attachments/1248198320250294302/1248198320367603823/image.png?ex=6662cac5&is=66617945&hm=db07c9fe19f09634b380c77393e9fe059a2291ecfa056996f3fa64a8b8fa6c2a&
i
I belive icontains-any uses comma separated values from the CSV:
Copy code
icontains-any: fruit, vegetable, cereals
for similar, the threshold is set like this:
Copy code
similar(0.5):fruit
v
Thanks a lot