https://promptfoo.dev/ logo
Multiple hand custom grading prompts
# ❓|questions
i
Hi, I'm using the custom grading prompt to specify a details about how I want the answer evaluated, which I update with the llm-rubric for each question. Can i run multiple of these for promptfoo to combine the results? e.g. One for testing coherence, one for llm-rubric. I ran them all (5 assertions) as one but the grader LLM messes up the addition at the end
Or can I run an assert like this but overriding the model-graded-qa method? "assert": "type": "model-graded-closedqa", "value": "file://consistency.txt"