roneyal
10/20/2023, 1:00 PMenv: {}
description: ''
providers:
- id: openai:gpt-4
prompts:
- |-
[
{
"role": "system",
"content": "You are an AI assistant."
},
{
"role": "user",
"content": "Below is a sentence in English. Please translate it into Pirate."
}
]
- |-
[
{
"role": "system",
"content": "You are an AI assistant."
},
{
"role": "user",
"content": "Another prompt..."
}
]
However, when I paste that into my promptfooconfig.yaml file, I get an error (ENAMETOOLONG) -- it appears to be trying to use all that text as the filename for the prompts.
Thanks!kevin427
10/21/2023, 2:02 PM# This configuration runs each prompt through a series of example inputs and checks if they meet requirements.
prompts: [prompts.txt]
providers: [openai:gpt-3.5-turbo-0613]
tests:
- description: prompt1
vars:
var1:
- |-
[
{
"role": "system",
"content": "You are an AI assistant."
},
{
"role": "user",
"content": "Below is a sentence in English. Please translate it into Pirate."
}
]
- description: prompt2
vars:
var1:
- |-
[
{
"role": "system",
"content": "You are an AI assistant."
},
{
"role": "user",
"content": "Another prompt..."
}
]
prompts.txt
{{var1}}kevin427
10/21/2023, 2:05 PMian
10/23/2023, 3:12 AMroneyal
10/23/2023, 3:18 PMroneyal
10/23/2023, 3:19 PMian
10/24/2023, 12:55 AMian
10/28/2023, 1:23 AMroneyal
11/06/2023, 10:05 PMroneyal
11/06/2023, 10:17 PMprompts: [prompts.js:prompt1, prompts.js:prompt2]
For some reason, that no longer works for me.ian
11/06/2023, 10:35 PMian
11/07/2023, 5:14 AMroneyal
11/07/2023, 10:12 AM