Will
05/21/2024, 1:59 AMproviders:
- id: openai:chat:accounts/fireworks/models/llama-v3-70b-instruct
config:
apiBaseUrl: https://api.fireworks.ai/inference/v1
apiKeyEnvar: FIREWORKS_API_KEY
This will result in the following error in promptfoo:
API error: [{'type': 'extra_forbidden', 'loc': ('body', 'seed'), 'msg': 'Extra inputs are not permitted', 'input': 0}], Type: invalid_request_error
{
"error": {
"object": "error",
"type": "invalid_request_error",
"message": "[{'type': 'extra_forbidden', 'loc': ('body', 'seed'), 'msg': 'Extra inputs are not permitted', 'input': 0}]"
}
}
I suspect it has to do with the slashes in the fireworks model naming conventions. They use the full accounts/fireworks/models/llama-v3-70b-instruct as the model value.ian
05/21/2024, 4:08 AMseed paramian
05/21/2024, 4:08 AMWill
05/21/2024, 11:06 AM