https://promptfoo.dev/ logo
Auth with google sheets
# ❓|questions
m
I want to store my dataset on private ggsheets behind workspace. Wonder if there are any possible way to do this in promptfoo
i
Hi @mrwildler, this PR adds support for private gsheets authenticated by service account: https://github.com/promptfoo/promptfoo/pull/686 It'll be in the next release after test out service accounts a bit
m
thank you!
i
Is this sheet public?
m
yes, i am using your example sheet
Strange, when i change the link to other sheets, it still return the same hash for dataset. Here my command: npx promptfoo@latest eval -c app/tests/promptfoo/config/agent_v2.yaml --no-cache --verbose
is this expected behaviour?
i
What happens if you go directly into that config directory and just run
promptfoo eval
?
m
it run fine if i rename the yaml to promptfooconfig and run directly from the dir
i
Interesting. Ok, sounds like a bug, I'll try to repro and fix it in the morning 🙂
m
thanks @ian
i
Fix here: https://github.com/promptfoo/promptfoo/pull/688 will be in the next release
2 Views