Hi all Livekit team and community 👋
Curious how people are building around Tool calling and MCPs.
Specifically about giving agents a dedicated and isolated execution environment to let them write code that calls MCPs or Tools via a generated API. In contrast to the traditional MCP/Tool definition passed to the LLM context window and letting the LLM chose. These two articles explain it very well:
•
https://blog.cloudflare.com/code-mode/
•
https://www.anthropic.com/engineering/code-execution-with-mcp
The main benefits on this approach:
• Huge (90%+ in some cases according to Anthopic) tokens saved.
• Less context bloating for llms
• LLMs hallucinate less due to shorter contexts and being much more versed at writing/reading code than MCP definitions.
I have 2 questions:
• Is Livekit Tool implementation more like traditional MCP? (my understanding is yes)
• Has anyone in the community started implementing tool calling like code execution?