rosniklazer_42497
11/07/2023, 11:21 PMian
11/07/2023, 11:31 PMopenai: providers?rosniklazer_42497
11/08/2023, 12:10 AMrosniklazer_42497
11/08/2023, 12:10 AMprompts: [prompts.json]
providers:
- id: openai:gpt-4
...rosniklazer_42497
11/08/2023, 12:20 AMian
11/08/2023, 6:07 AMyaml
postprocess: JSON.stringify(output)
just to make sure I understand, this happens when the LLM output is valid JSON?rosniklazer_42497
11/08/2023, 4:46 PMian
11/08/2023, 4:50 PMpostprocess directive should work here thenrosniklazer_42497
11/08/2023, 4:57 PMrosniklazer_42497
11/08/2023, 5:00 PMian
11/08/2023, 5:02 PMian
11/08/2023, 5:03 PMian
11/08/2023, 5:03 PMpostprocess directive that we added makes the LLM output a string. So your tests will have to assume the output is a string rather than an objectrosniklazer_42497
11/08/2023, 5:08 PMian
11/08/2023, 5:22 PMian
11/08/2023, 5:47 PM__expected fix and the changes just released in version 0.26.3, your setup should properly compare (remove the postprocess directive)ian
11/08/2023, 5:48 PMrosniklazer_42497
11/08/2023, 6:41 PMrosniklazer_42497
11/08/2023, 6:42 PMrosniklazer_42497
11/08/2023, 6:55 PMian
11/08/2023, 7:01 PMrosniklazer_42497
11/08/2023, 7:08 PMian
11/08/2023, 8:32 PM{content, function_call}. Would that help?
I can't change the default behavior for now because it would break pretty much everyone