boundary

Seems that no chunks are streamed when using anthropic models on vertex. Works when not streaming. Any known issues with that - could just be it's not supported on provider side but unsure

No known issues, it _should_ work, there are separate endpoints for stream vs not in vertex anthropic

Ohh that could be it then thanks will look into that

I meant as in `provider vertex-ai` switches between the streaming and non-streaming endpoints depending on which type of client you're using

Weird, I am seeing an issue with this in the playground

yeah no luck so far, this is my client setup btw
```
client<llm> VertexSonnet {
  provider vertex-ai
  retry_policy SimpleConstant
  options {
    model "claude-sonnet-4@20250514"
    credentials env.GOOGLE_APPLICATION_CREDENTIALS
    anthropic_version "vertex-2023-10-16"
    base_url "https://us-east5-aiplatform.googleapis.com/v1/projects/magnitudeai/locations/us-east5/publishers/anthropic/models"
  }
}
```

Is the error you're getting " Stream ended without response (Unspecified error code: 2) - Stream ended without response" or is it something else?

i.e. this will not error, it will just produce nothing
```
import { b } from 'llm-core';

const stream = b.stream.VertexSonnetTest();

for await (const chunk of stream) {
    console.log("Chunk:", chunk);
}
```

Will let you know when I've figured out what's going on here!

oh after a very long time i eventually get this:
```
Stream started
2025-09-26T18:19:20.909 [BAML WARN] Function VertexSonnetTest:
    (3 other previous tries)
    Client: VertexSonnet (<unknown>) - 79900ms
    ---PROMPT---
    user: Tell me a long story about sloths

    ---REQUEST OPTIONS---
    anthropic_version: "vertex-2023-10-16"
    max_tokens: 4096
    ---ERROR (Unspecified error code: 2)---
    Stream ended without response
Stream done
```

min reprod https://github.com/anerli/baml-vertex-anthropic-stream-bug-reprod

It s a type issue, we cant parse the response

scratch that, going out tomorrow (sunday). Will ping announcements channel when it is out