https://promptfoo.dev/ logo
Built-in flow to allow user to upload a .csv file ...
# ❓|questions
a
Hey team, are there plans at the moment to have an interface/flow available out of the box that: 1. Let's a user upload a .csv file containing the data to be evaluated 2. After uploading is done, run the evaluate() CLI command through it 3. Show the result with aggregated statistics of the pass/fail at the top, along with the results at the bottom (last part is the same as to what is avaialble in
promptfoo view
today
i
The
tests
property/CLI arg currently supports a csv file. That sounds similar to what you want? https://promptfoo.dev/docs/configuration/parameters/#import-from-csv
a
Hey yeah it should be, I just wondering if there's gonna be a UI option for
uploading
csv basically
But for sure we can go with that CLI option as well
@ian out of curiousity is the csv option available through the
evaluate()
node module?
i
yeah it should be, because
evaluate
calls
readTests
which does the file reads
but not as flexible as the CLI-supported CSV format
a
would it run the configs defined in
promptfooconfig.yaml
when you upload a CSV from that button?
i
it would run on whatever is defined in that interface, which is a bit more limited than the yaml
if you run an eval with the yaml, clicking 'edit eval' will load the yaml into that UI
a
you mean clicking
edit eval
in the UI right?
ahh ok got it, I was thinking of making it into a constantly running web service that can just accept a csv we want to evaluate using a set of assertions and LLM API configs that we want to use
i
ok yeah, we are talking about something different then
a
Ok got it
i
we'd find that useful on our end too...
just need to build it
a
That's not a priority for me at the moment, but its one of the things I wanna be able to do with promptfoo in the future
i
good to know
a
I will let you know if we decided to invest resources into making that available
it's not a priority for now, but it might be later
i
cool, I will also put it on my backlog
2 Views