https://promptfoo.dev/ logo
Does promptfoo execute MCP tool calls?
# ❓|questions
s
I’m wondering if promptfoo executes a MCP models tool calls, when it’s requested by the model or is that only possible when function callbacks are implemented?
i
let me ping our mcp guy @[Promptfoo] Faizan
s
any updates
u
Hey! It seems like mcp tool calls weren't implemented yet- I can take a look and push a change. Just wondering @sasha, are you using a built in model or using some kind of js/python/custom provider? Promptfoo will only call tools if used with an agentic api, like a completion or response api model
s
I’m using some custom provider. It’s a response api model generally
u
Hey- so sorry for the late reply. Since you're using a custom provider, you should probably call the tool in the provider itself. You can see an example of that here: https://github.com/promptfoo/mcp-agent-provider/blob/main/src/react-agent.js