https://promptfoo.dev/ logo
LLM prompt test against custom dataset (i.e. Demen...
# ❓|questions
j
I want to test different models on how it would respond to a dataset from Kaggle. i.e. dementia dataset prompt: "Average age for dementia?"
m
Hi @jonatng 🎲 You can download the dataset as a CSV and then import it into your promptfooconfig that way. See https://www.promptfoo.dev/docs/configuration/parameters/#import-from-csv and https://github.com/promptfoo/promptfoo/tree/main/examples/simple-csv
j
thank you, this is what I needed
m
Let us know if you run into any other issues!
j
I see, CSV is another format to store the tests. I was looking to see if one can chat with the database like this one https://github.com/sinaptik-ai/pandas-ai/blob/main/pandasai/smart_dataframe/__init__.py
i
unfortunately no direct integration for databases
we support huggingface datasets too in case that helps https://www.promptfoo.dev/docs/providers/huggingface/#datasets
2 Views