Some users have reported my livekit agent isn't pi...
# ask-ai
t
Some users have reported my livekit agent isn't picking up their speech even though they can see their microphone is receiving correctly. Checking on livekit cloud insights I see no audio recorded at all. But some of the logs do include "input speech hasn't started yet, skipping silence padding, recording may be inaccurate until the speech starts"
✅ 1
t
Thanks for reaching out, Tom. I'm an AI assistant and I'm here to help. Give me a moment while I research this topic.
Thanks — I hear you: users see mic input but the agent records no audio and logs show "input speech hasn't started yet, skipping silence padding…". I'll help troubleshoot. Quick checks first (please tell me the answers): • Is Observability enabled for your LiveKit project? (Project settings → Data and privacy) • Which Agent SDK version are you running (Python/Node)? • Do you explicitly disable recording in code (e.g.,
record=False
or
record={ "audio": false }
)? • Do problems occur for all users or only some devices/browsers? If those are all OK, try these steps and tell me what you see: 1. Enable debug logs on the agent and reproduce the issue. Look for messages like "uploading session report to LiveKit Cloud" and "finished uploading". 2. Verify audio frames reach the agent even when VAD doesn't trigger (check raw audio input logs). This confirms whether capture or VAD is the problem. 3. Check/adjust VAD settings: ◦ Lower the activation threshold (Silero VAD
activation_threshold
) if users speak softly. ◦ Reduce
min_speech_duration
or
min_silence_duration
if speech segments are very short. 1. If using server-side real-time turn detection (Azure/Grok), lower the
threshold
or shorten `silence_duration_ms`/`prefix_padding_ms`. 2. Try enabling enhanced noise cancellation in room options — noise suppression can improve detection in noisy environments. 3. Confirm the agent cleanly shuts down and uploads observability data; crashes or abrupt shutdowns can prevent audio upload. If you can share: • SDK version, project ID (or room/session ID), and a short excerpt of the agent debug logs around the "input speech hasn't started yet" message — I’ll look for whether audio frames arrive and whether VAD is failing to mark speech. Sources: Why is my Agent insights data missing? | LiveKit | Using a transformer to improve end of turn detection | LiveKit | Speech-to-text (STT) models overview | LiveKit Documentation | Silero VAD plugin | LiveKit Documentation | Turns overview | LiveKit Documentation, with interactive elements
t
• Observability is • I'm running livekit-agents 1.5.2 (pypi) • No • Only some, and for one user it occured once but on the 2nd time worked fine https://cloud.livekit.io/projects/p_52cs00mzqow/sessions/RM_RZxvsRJrpLJH/
t
Thanks — this is helpful. I’m responding to your note that observability is enabled, you’re on livekit-agents 1.5.2, recording isn’t disabled, and the issue is intermittent for some users (one user had it once then it worked). Next steps I recommend—please try them and share results or the requested logs: 1. Enable debug logging on the agent and reproduce the issue for a user who experienced it. Share the log excerpt around the "input speech hasn't started yet..." message (±10–20 lines). 2. While reproducing, confirm whether raw audio frames reach the agent: ◦ Look for logs showing incoming audio frames or audio buffer sizes before VAD logs. If frames arrive but VAD never triggers, VAD sensitivity is likely the issue. 1. Adjust VAD sensitivity (Silero VAD): ◦ Lower
activation_threshold
(make detection more sensitive). ◦ Reduce
min_speech_duration
and/or
min_silence_duration
if speech segments are short. 1. If you use server-side turn detection (real-time STT models), try lowering the
threshold
and shortening `silence_duration_ms`/`prefix_padding_ms`. 2. Toggle enhanced noise cancellation in room options for affected users and retest—this often helps in noisy environments or with low-volume speech. 3. Confirm session upload completed after the call: check for "uploading session report to LiveKit Cloud" and "finished uploading" in logs. If missing, include shutdown/crash logs. Please paste: • The debug log excerpt around the VAD message, • SDK (agent) config snippet showing VAD or turn-detection settings if you’ve customized them, • Room/session ID (you already shared RM_RZxvsRJrpLJH — thanks). With the logs and any VAD config you’ve set, I’ll pinpoint whether this is capture vs. VAD sensitivity vs. upload issues and give the exact config change to try. Sources: examples/frontdesk | livekit/livekit_composite | DeepWiki | Using a transformer to improve end of turn detection | LiveKit | Silero VAD plugin | LiveKit Documentation | Turns overview | LiveKit Documentation | Agent session | LiveKit Documentation, with interactive elements