lucky_monkey_44174
01/08/2025, 2:56 PMian
01/08/2025, 7:34 PM--verbose option so we can get more debug output? That will help us troubleshoot
promptfoo redteam run --verboselucky_monkey_44174
01/08/2025, 7:49 PMlucky_monkey_44174
01/08/2025, 8:06 PMproviders to put a python script instead of a request. I created the .py script but it doesn't seem to be able to access it. What whould my config file look like if I want to ping a function inside python instead of passing by promptfoo to ping my API?lucky_monkey_44174
01/08/2025, 8:14 PMian
01/08/2025, 8:49 PMhttps://api.promptfoo.app/taskian
01/08/2025, 8:49 PMlucky_monkey_44174
01/08/2025, 8:55 PMtarget with a python script correct?
Referencing here: https://discord.com/channels/1153767083381903389/1309447535416315967
Thank you for your help! Super appreciated.ian
01/08/2025, 11:34 PMcurl https://api.promptfoo.app/task work or do you have to do something to authenticate?ian
01/08/2025, 11:35 PMcall_apis.py target looks ok to me. what exactly is not working? are you able to see more when you pass --verbose to the run?lucky_monkey_44174
01/09/2025, 2:04 PMlucky_monkey_44174
01/09/2025, 2:05 PMlucky_monkey_44174
01/09/2025, 5:27 PMian
01/09/2025, 9:34 PMian
01/09/2025, 9:35 PMpromptfoo redteam run -c config.yaml
It's also possible to run test generation separately from the eval itself. For example:
promptfoo redteam generate -c config.yaml
This will create a redteam.yaml. Then you can run
promptfoo redteam evallucky_monkey_44174
01/10/2025, 12:29 PM