Team, We are facing a latency issue where it takes...
# agents
h
Team, We are facing a latency issue where it takes ~4 secs for ai to speak post the user (human) ends speaking. We are seeing in the logs that the LLM (gemini 2.5 flash) is taking ~3 sec to give the first token. What's the way to manage this ? What's the latency everyone else is getting ?
l
This is similar to https://livekit-users.slack.com/archives/C07FY8WHGPM/p1764679505720079 and I can't improve on the answer there, though I would emphasise the point about using Agent Observability to better understand where your latency is.