https://www.boundaryml.com logo
Is prompt caching supported by default?
# help
a
I see this open issue present: https://github.com/BoundaryML/baml/issues/2719 But was wondering if for most 3rd party (non local) providers, if prompt caching is enabled, or if we need to configure it.
Ah, in the docs this is for the Anthropic Client: https://docs.boundaryml.com/guide/baml-advanced/prompt-caching-message-role-metadata It looks like openai models have it on by default (?), but nothing for gemini
v
Yep!
Exactly that