https://promptfoo.dev/ logo
Eval on pre-existing model response
# questions
a
Hello. I have tested one application previously and used red Teaming. So for asserting it uses the default one. Now I want to test g-eval for asserting, but don't want to generate any new responses. I want to compare the g-eval results and the default one results with the same responses. Is there a way to use g-eval on pre-existing tests and responses? While going through documentation I came across one flag, --model-outputs, but not much details about how to use that.
m
a
Hey, thank you. But while using echo, only responses can be used while assertion. But what if we want both input prompts and response to be sent to evaluation system
m
It should still work. You can define vars next to the output and both the vars and the output are all available to the assertion.