raghadn3
02/23/2024, 7:39 AMian
02/24/2024, 7:43 PMapiEndpoint you have doesn't look like a huggingface hosted inference endpoint. The endpoint URL should look something like this:
https://v9igsezez4ei3cq4.us-east-1.aws.endpoints.huggingface.cloud
And you need to create an endpoint using the "Create a new Endpoint" functionalityian
02/24/2024, 7:43 PMyaml
description: 'HF private inference endpoint'
prompts:
- "Write a tweet about {{topic}}:"
providers:
- id: huggingface:text-generation:gemma-7b-it
config:
apiEndpoint: https://v9igsezez4ei3cq4.us-east-1.aws.endpoints.huggingface.cloud
# apiKey: abc123 # Or set HF_API_TOKEN environment variable
tests:
- vars:
topic: bananas
- vars:
topic: potatoesraghadn3
02/25/2024, 1:41 PM