Powered by
Is prompt caching supported by default?
# help
a
abrowne2
01/27/2026, 6:11 PM
I see this open issue present:
https://github.com/BoundaryML/baml/issues/2719
But was wondering if for most 3rd party (non local) providers, if prompt caching is enabled, or if we need to configure it.
abrowne2
01/27/2026, 6:15 PM
Ah, in the docs this is for the Anthropic Client:
https://docs.boundaryml.com/guide/baml-advanced/prompt-caching-message-role-metadata
It looks like openai models have it on by default (?), but nothing for gemini
v
Vaibhav (BAML 🐑)
01/27/2026, 8:44 PM
Yep!
Vaibhav (BAML 🐑)
01/27/2026, 8:44 PM
Exactly that
Previous
Next