fabioxgn
11/27/2023, 3:08 PMgpt-4.yaml :
id: 'gpt-4-1106-preview'
config:
"functions": [
{
"name": "get_current_weather",
Then I tried to execute eval -r gpt-4.yaml and also adding providers: [gpt-4.yaml] to my test config, but both raises:
gpt-4.yaml:3
"functions": [
^
SyntaxError: Unexpected token ':'
is this possible? How would I approach a centralized definition for a config containing function calls? I have some function definitions that will be used for all prompts and I'm trying to centralize the configuration in a single file that can be used by multiple prompt tests.
Thanks! 🙇♂️ian
11/27/2023, 3:11 PM.yaml provider imports are supported right now. However, it wouldn't be too difficult to add- let me see what I can do.fabioxgn
11/27/2023, 3:35 PMian
11/27/2023, 3:42 PMian
11/27/2023, 3:43 PMyaml
providers:
- file://gpt-3.5.yaml
- file://gpt-4.yaml
# ...
It'll be in the next release
https://github.com/promptfoo/promptfoo/pull/296fabioxgn
11/27/2023, 4:09 PMfabioxgn
11/27/2023, 4:09 PM