https://promptfoo.dev/ logo
Not possible to see OpenAI Chat Completion with me...
# ❓|questions
j
It looks like the output from the providers code does an OR allowing the message content OR the tool calls but not both
Copy code
//from providers/openai.ts line 456
 const output =
        message.content === null ? message.function_call || message.tool_calls : message.content;
The use case which is becoming more popular is you want the content to be an inner monologue which determines the tool call. My workaround for now is that I'll create a custom provider for OpenAI, and pass them both to output in a way that I can make assertions.
i
This is a good suggestion, I think there should be some secondary
output
field that could include tool call context and whatnot. Or alternatively, a dedicated tool call field in the return value
6 Views