I have custom agents built using Theia AI. Is promptfoo a right framework to evaluate custom agents?
Can i handle this using custom typescript/python script?
Yes @Tabs [Promptfoo] .... I have checked this custom implementation. Similar to direct MCP support we donot have any agent support in promptfoo.. everything should be handled from scratch?
t
Tabs [Promptfoo]
08/04/2025, 6:16 AM
If there's no framework or language already supported and you want to use Promptfoo to test it then yes you'll need to write that part yourself