khat-er
11/08/2023, 9:54 AMkhat-er
11/08/2023, 11:25 AMian
11/08/2023, 3:49 PMian
11/08/2023, 3:51 PMkhat-er
11/08/2023, 4:52 PMian
11/08/2023, 5:12 PMdeployment_id and dataSources in the configs field. An example value of dataSources is:
js
dataSources=[
{
"type": "AzureCognitiveSearch",
"parameters": {
"endpoint": "...",
"key": "...",
"indexName": "...",
}
}
]
or yaml equivalent 🙂khat-er
11/09/2023, 8:24 PMian
11/09/2023, 8:47 PMkhat-er
11/09/2023, 8:50 PMkhat-er
11/09/2023, 8:51 PMkhat-er
11/09/2023, 8:51 PMkhat-er
11/09/2023, 10:02 PMian
11/09/2023, 10:55 PMian
11/09/2023, 10:55 PMkhat-er
11/13/2023, 2:50 PMian
11/13/2023, 3:44 PMproviders list is for prompting. To set this as the embedding provider, you must set it on the test case itself or in defaultTest. See the example here 🙂 https://promptfoo.dev/docs/configuration/expected-outputs/similar#overriding-the-providerkhat-er
11/13/2023, 4:14 PMkhat-er
11/14/2023, 10:44 AMian
11/14/2023, 5:16 PMconetent ?khat-er
11/14/2023, 5:18 PMkhat-er
11/14/2023, 5:18 PMian
11/14/2023, 5:22 PMian
11/14/2023, 5:47 PMprompts should be an array of prompts, not a single prompt array (you're missing wrapping [ ]). here's an example https://github.com/promptfoo/promptfoo/blob/main/examples/node-package/index.js#L6-L19
2. You'll have to update to version 0.27.0 - I've added support for prompt objects in calls to evaluatekhat-er
11/14/2023, 7:37 PMian
11/14/2023, 7:39 PMkhat-er
11/14/2023, 9:04 PMkhat-er
11/14/2023, 9:05 PMian
11/14/2023, 9:14 PMian
11/14/2023, 9:14 PMkhat-er
11/14/2023, 9:17 PMkhat-er
11/14/2023, 9:18 PMian
11/14/2023, 9:19 PMprompts, but it expects an array of prompts. You should wrap it like so:
js
prompts: [
[
{
role: 'system',
content: '...',
},
{
role: 'user',
content: '...',
},
]
],khat-er
11/14/2023, 9:19 PMkhat-er
11/14/2023, 9:19 PMian
11/14/2023, 9:20 PMkhat-er
11/14/2023, 9:20 PMkhat-er
11/14/2023, 9:21 PMkhat-er
11/14/2023, 9:22 PMkhat-er
11/14/2023, 9:24 PMkhat-er
11/14/2023, 9:27 PMkhat-er
11/14/2023, 9:28 PMian
11/14/2023, 9:30 PMkhat-er
11/14/2023, 9:31 PMkhat-er
11/14/2023, 9:32 PM