https://promptfoo.dev/ logo
Running assertions on outputs while using variable...
# ❓|questions
m
Hi, I understand I can use
promptfoo eval —assertions assert.yaml —model-outputs outputs.json
to run asserts on already generated outputs. But, i can’t see how to pass variables to LLM-rubrics with a csv file in this case. Using the —vars or —tests command seems to ignore —model-outputs. It does work with —var key=value but it would apply the same value for all my outputs
v
Hi @marcotot.! This is not currently supported. As a workaround, you could write a script to converrt your csv to a promptfooconfig.yaml. If you share the first few rows of your CSV and your promptfooconfig I can help get you set up.
m
Thanks! Ill try to do it that way, I’ll reach out in case I have other issues