dadatm
11/18/2024, 3:50 PMpromptfoo eval generates different failing test cases.
Something else that I have noticed is that the exact same prompt generates different responses from the actual app. I should be using the same prompts and settings (temperature of 0) and yet the app every now and then is giving slightly different responses from propmptfoo.
Any idea on how i can debug the issue or I can check what's going on?kentyman
11/18/2024, 4:09 PMian
11/18/2024, 9:34 PMseed paramdadatm
11/19/2024, 3:16 PMdadatm
01/17/2025, 12:47 PMkentyman
01/17/2025, 5:11 PMproper_cissp_35993
01/17/2025, 6:26 PMproper_cissp_35993
01/17/2025, 6:27 PMdadatm
02/28/2025, 8:29 AMkentyman
02/28/2025, 1:20 PM