Powered by
Anyone messing with promptfoo + vercel AI SDK? How...
# ❓|questions
w
Will
09/04/2024, 2:03 AM
Just curious how folks are setting this up.
m
michaelmichaelmichael
09/06/2024, 4:52 PM
Hi
@Will
we have an example of the vercelAi SDK here
https://github.com/promptfoo/promptfoo/blob/feat/markdown-prompt/examples/custom-provider/vercelAiSdkExample.js
as a custom provider. We would welcome better native support if you're up for trying it out. Please let us know how it goes!
w
Will
09/08/2024, 3:51 AM
hi
@michaelmichaelmichael
- got a 404 here
Will
09/08/2024, 3:51 AM
definitely interested in trying it out!
Will
09/08/2024, 3:52 AM
my main reason for wanting to use the vercel ai sdk here is because we have started to use the zod schema -> generateObject through the vercel AI SDK and that doesn't seem very well supported by promptfoo yet
m
michaelmichaelmichael
09/08/2024, 6:47 AM
Ah I am sorry. Try
https://github.com/promptfoo/promptfoo/blob/main/examples/custom-provider/vercelAiSdkExample.js
We will happily accept a PR that adds native support for Vercel if you have the time. I recently added native support for groq
https://github.com/promptfoo/promptfoo/pull/1479
and shipped a major update for mistral
https://github.com/promptfoo/promptfoo/pull/1614
Adding support for vercel would look a lot like either of these PRs (and may be as simple as one conversation with claude 3.5)
Previous
Next