how can I use the Anthropic models through my AWS bedrock account?

Hey! It's pretty quick but you have to manually enable them first since AWS keeps them locked by default. ​Just head to Amazon Bedrock in the console, click Model access on the left sidebar, and hit "Manage model access"...check the boxes for the Claude models you want and submit the request. It usually approves instantly. ​One heads up: if it's your first time using Anthropic on that account you'll need to open the Bedrock chat playground and fill out a quick use-case form before it actually lets you make API calls..after that you're good to start hitting it with boto3

Thanks Aman, I was actually asking which option I should choose from here

Hey Hasan! So the dropdown doesn't have a "Bedrock" option directly — here's the actual fix: 1. Toggle ON "Advanced" at the top of that LLM settings screen (you can see it's currently off) 2. In the model field that appears, type the model manually using LiteLLM's Bedrock format:

bedrock/anthropic.claude-3-5-sonnet-20241022-v2:0

3. Leave the API Key field blank — Bedrock doesn't use an API key. Instead you need to set these as environment variables before starting OpenHands:

export AWS_ACCESS_KEY_ID=your_key
export AWS_SECRET_ACCESS_KEY=your_secret
export AWS_REGION_NAME=us-east-1

4. Make sure you've already enabled model access for Claude in the Bedrock console (the step I mentioned earlier) otherwise you'll get a permissions error even with correct creds. So to answer your original question neither aws_polly nor AWS SageMaker is what you want. Both are unrelated services to this bro and polly is text-to-speech, SageMaker is for custom model hosting. Bedrock is configured through the Advanced toggle + the

bedrock/

model prefix.