https://www.boundaryml.com logo
🟡 Request for original LLM response alongside typ...
# questions
b
When using
baml-cli
to serve OpenAPI, is it possible to receive the original LLM response along with the type-parsed one? I'd like to send back the original response in subsequent requests as opposed to the parsed one in order to utilize the LLM cache in case of back-and-forth applications (chats or agents using many tools). If not possible, is it considered in the roadmap?
v
This is definitely on the roadmap. We are considering how to support this better without making th http response super noisy.
Curious what language are you using it with
b
Elixir
spawning the
baml-cli serve
under supervision tree