Powered by
LLM prompt test against custom dataset (i.e. Demen...
# ❓|questions
j
jonatng 🎲
02/23/2025, 11:45 PM
I want to test different models on how it would respond to a dataset from Kaggle. i.e. dementia dataset prompt: "Average age for dementia?"
m
michaelmichaelmichael
02/24/2025, 12:21 AM
Hi
@jonatng 🎲
You can download the dataset as a CSV and then import it into your promptfooconfig that way. See
https://www.promptfoo.dev/docs/configuration/parameters/#import-from-csv
and
https://github.com/promptfoo/promptfoo/tree/main/examples/simple-csv
j
jonatng 🎲
02/24/2025, 12:34 AM
thank you, this is what I needed
m
michaelmichaelmichael
02/24/2025, 2:36 AM
Let us know if you run into any other issues!
j
jonatng 🎲
02/24/2025, 4:55 AM
I see, CSV is another format to store the tests. I was looking to see if one can chat with the database like this one
https://github.com/sinaptik-ai/pandas-ai/blob/main/pandasai/smart_dataframe/__init__.py
i
ian
02/27/2025, 7:28 PM
unfortunately no direct integration for databases
ian
02/27/2025, 7:28 PM
we support huggingface datasets too in case that helps
https://www.promptfoo.dev/docs/providers/huggingface/#datasets
2
Views
Previous
Next