I did a session by myself and I am looking at the ...
# ask-ai
f
I did a session by myself and I am looking at the Agent Analytics page. Do you think performance will be affected if the Anam Agent joins in US Central and the LiveKit server is in US East?
✅ 1
t
Thanks for reaching out, Ganesh. I'm an AI assistant and I'm here to help. Give me a moment while I research this topic.
Thanks — I’m responding to your question about whether performance will be affected if the Anam Agent is in US Central while the LiveKit server is in US East. Short answer: likely only a small-to-moderate impact. WebRTC (LiveKit) is optimized for real‑time media so the user⇄server hop within the same country typically adds only modest latency. The bigger factor is where the AI model stack (STT/LLM/TTS) runs — agent⇄model latency usually dominates end‑to‑end turn times. If the agent and models are colocated (or the agent is colocated with the model region), you’ll get the best results. Recommendations: • If possible, host the agent in the same region as the model stack (or move models to the agent’s region) to minimize agent⇄model API latency. • Measure per-stage latency with Agent Observability / per-turn metrics (e.g.,
e2e_latency
) to find the real bottleneck (STT, LLM, or TTS). • If you see higher-than-expected latency, share a sample turn’s latency breakdown and timestamps and I’ll help interpret them. Would you like me to walk you through pulling the observability metrics for this session? Sources: Understand and Improve Agent Latency | LiveKit | Decentraland's Catalyst: using WebRTC to interact in the metaverse | LiveKi..., with interactive elements
f
From the looks of what I researched, it said the following: Deepgram utilizes cloud infrastructure, with specific documentation pointing to resources provisioned in the GCP us-west1 region. ElevenLabs’ default infrastructure for the Americas routes to US-Central for processing. Probably the issue for a lot of the latency I am experiencing then huh?
t
You’re on the right track — those regional differences likely explain much of the latency you’re seeing. Why: • Each hop to a differently located service adds network and processing latency. Deepgram in GCP us-west1 and ElevenLabs routing to US‑Central means your audio is traveling between regions before/after the agent processes it. • Agent⇄model (STT/LLM/TTS) latency typically contributes far more to turn time than client⇄LiveKit server latency, so mismatched model locations will show up as the largest source of delay. What to try next: • Align regions where possible: host the agent and any models (or prefer model endpoints) in the same region as each other to cut internal API round trips. • Run measured tests: capture per-stage latency (STT, LLM, TTS, network) from Agent Observability or per‑turn metrics so you can quantify which provider/step adds the most time. • Short-term mitigation: if you can’t move services, try routing the LiveKit server to a region that reduces total round trips (choose a compromise region) or use lower-latency model endpoints if available. If you want, share a sample turn’s latency breakdown (STT, LLM, TTS, and network times) and I’ll help interpret where to focus optimizations. , with interactive elements