over longer conversations my agent starts getting ...
# ask-ai
r
over longer conversations my agent starts getting slower nad slower to respond. what is the fix for this
t
Thanks for reaching out, Rhythm. I'm an AI assistant and I'm here to help. Give me a moment while I research this topic.
Sometimes, agents might slow down during longer chats because of things like latency, network distance, or how resources are managed. Here are a few friendly tips to help fix that: • Optimize Network Proximity: Try to host the agent close to the services it depends on to cut down on latency. • Monitor Latency: Keep an eye on important metrics like Time To First Token (TTFT) and Time To First Byte (TTFB) using the Metrics API to spot any slowdowns. • Handle Network Congestion: Consider settings that can help manage congestion, like pausing videos or tweaking UI elements when things get busy. • Improve Tool Call Efficiency: Make external tool calls more efficient and give users feedback during any delays to keep the experience smooth. Also, gathering detailed metrics on parts like STT, TTS, and LLM can really help find the root of the problem. If you'd like, I’m here to help you with any of these steps! Sources: Voice Assistants | livekit/livekit_composite | DeepWiki | Tool definition and use | LiveKit Docs | Capturing metrics | LiveKit Docs | Agent Testing & Evaluation | livekit/livekit_composite | DeepWiki | Voice Assistants | livekit/livekit_composite | DeepWiki