https://promptfoo.dev/ logo
OpenAI tool callbacks in chat completion
# ❓|questions
s
I have a couple of tools configured in my openai provider and have a prompt that successfully generates calls to those tools ... is there anyway to get promptfoo to use the functionToolCallbacks feature? Looking at the code that might only be available for assistants? One of the things I want to be able to test is what would go in the instructions for the assistant, so having to define it in the openai playground isn't very convenient.
i
Hmm, seems useful to add this to the regular chat completions handler. As you noted, right now this is only supported for assistants right now
s
That would be great. I'm trying an assistant with blank instructions for now.
i
will get it done 🙂 PR in progress here https://github.com/promptfoo/promptfoo/pull/830
s
🤩