https://www.boundaryml.com logo
🟑 404 Error for Claude Model 4.6 on Vertex AI
# questions
a
getting 404 for claud model 4.6 opus on vertex ai provider requested URL /v1/projects/xxxxxxxxxx/locations/global/publishers/anthropic/models/claude-opus-4-6:streamRawPredict was not found on this server. That’s all we know. , statuscode=404, detailed_message=3 failed attempts: Attempt 0: LLM client "CustomClaudeOpus46" failed with status code: Unspecified error code: 404 Message: Request failed with status code: 404 Not F
my client client CustomClaudeOpus46 { provider vertex-ai retry_policy Exponential options { model "claude-opus-4-6" anthropic_version "vertex-2023-10-16" base_url "https://global-aiplatform.googleapis.com/v1/projects/xxxxxx/locations/global/publishers/anthropic/models" // Don't need to specify location when using explicit base_url // Don't need project_id when it's in the base_url } }
i am on 0.210.0
client VertexClaudeSonnet { provider vertex-ai options { model "claude-sonnet-4" anthropic_version "${ANTHROPIC_VERSION}" base_url "https://${LOCATION}-aiplatform.googleapis.com/v1/projects/${PROJECT_ID}/locations/${LOCATION}/publishers/anthropic/models" } }
this is provided in your docs but does not work
only way it works if i hard code my project_id that is not a good option please help with this
i ended creating and env variable for the full base url you should update your docs
is generationConfig { thinkingConfig { includeThoughts true } } only works in gemini , is it supported in claude i get an error for it
v
thansk for sharing this, sorry about that lack of update on docs here
We had people out of discord today! apologies for the delay here πŸ™
3 Views