https://promptfoo.dev/ logo
Anyone messing with promptfoo + vercel AI SDK? How...
# ❓|questions
w
Just curious how folks are setting this up.
m
Hi @Will we have an example of the vercelAi SDK here https://github.com/promptfoo/promptfoo/blob/feat/markdown-prompt/examples/custom-provider/vercelAiSdkExample.js as a custom provider. We would welcome better native support if you're up for trying it out. Please let us know how it goes!
w
hi @michaelmichaelmichael - got a 404 here
definitely interested in trying it out!
my main reason for wanting to use the vercel ai sdk here is because we have started to use the zod schema -> generateObject through the vercel AI SDK and that doesn't seem very well supported by promptfoo yet
m
Ah I am sorry. Try https://github.com/promptfoo/promptfoo/blob/main/examples/custom-provider/vercelAiSdkExample.js We will happily accept a PR that adds native support for Vercel if you have the time. I recently added native support for groq https://github.com/promptfoo/promptfoo/pull/1479 and shipped a major update for mistral https://github.com/promptfoo/promptfoo/pull/1614 Adding support for vercel would look a lot like either of these PRs (and may be as simple as one conversation with claude 3.5)