jonasmuller1383
11/07/2023, 1:22 PMjson
{
"assertionTemplates": {
"containsMentalHealth": {
"type": "javascript",
"value": "output.toLowerCase().includes('mental health')",
"provider": "openai:gpt-3.5-turbo-0301"
}
},
"prompts": [
"prompts.txt"
],
"providers": [
"openai:gpt-3.5-turbo-0301"
],
"tests": [
{
"vars": {
"question": "Tell me about the benefits of exercise."
},
"assert": [
{
"$ref": "#/assertionTemplates/containsMentalHealth"
}
]
}
]
}ian
11/07/2023, 5:20 PM.json configs as well https://github.com/promptfoo/promptfoo/commit/c32f9b051a51ee6e1ee08738e0921b4e05a5c23d
It will be included in the next release!jonasmuller1383
11/07/2023, 5:25 PM