https://promptfoo.dev/ logo
GUI for spec-entry
# ❓|questions
w
I've seen the experimental web UI for displaying input/output/results, has anyone written and shared a UI for entry of providers, tests, assertions, etc? All of the ingredients for the yaml file?
i
The web UI actually does have a way to enter providers, tests, etc and run a new eval. It's in the "New Eval" tab which can be reached in the nav menu up top https://cdn.discordapp.com/attachments/1222717029044195429/1222869903472857178/image.png?ex=6617c958&is=66055458&hm=5502eb75123a8650d63a22e9efc1b6a4e076eb2c6e2f690589325c0f1c3bee93&
w
Thanks. I'm about to experiment with Azure OpenAI, which I saw your documentation for. 1) does it matter if the yaml config for the apiHost value includes the 'https://' prefix? Also, is there a place to expect an error/warning for malformed YAML when manually editing? I realize this is an experiment,and may not do everything.
Yeah, looks like the prefix has to be removed
i
yeah 🙂
for malformed yaml, it will catch some cases but unfortunately there are many ways to mess up yaml!
2 Views