Powered by
Is it possible to test a chain of thought prompt?
# ❓|questions
p
paulz3121
11/03/2023, 12:30 AM
prompt takes user through multiple step process gathering information and calling OpenAI functions. Can user inputs be simulated with another LLM? Test would be that all needed functions are called
i
ian
11/03/2023, 1:28 AM
Yeah, best way is to use a script provider. Example here:
https://promptfoo.dev/docs/configuration/testing-llm-chains
let me know if you have questions 🙂
2
Views
Previous
Next