LiveKit Community

Does Livekit support any kind of Observability of LLM calls?

Thanks for reaching out, Anton. I'm an AI assistant and I'm here to help. Give me a moment while I research this topic.



Yes, LiveKit supports observability of LLM calls through a feature called `LLMCallbacks`. This includes a callback function that receives metrics data, allowing you to observe and collect metrics from LLM calls. If you need further details or examples, feel free to ask!
 Sources: <https://docs.livekit.io/agents-js/types/agents.llm.LLMCallbacks.html|LLMCallbacks | LiveKit Agents>