Hey! Our team switched over from google cloud over to livekit cloud for our agents. What I noticed after switching is that the silero/vad inference becomes slower than realtime. Looking at the delay, the inference can be delayed up to 15 seconds at the worst conditions. Is there any way we can optimize this? I tried prewarming the model but it still has some noticeable delay. Here is our configuration and some trace logs.
def prewarm(proc: JobProcess):
"""Prewarm models at worker startup for faster job handling."""
proc.userdata["vad"] = silero.VAD.load(
min_silence_duration=0.5,
activation_threshold=0.4
)
Trace error logs we see:
Inspect log
Dec 19, 2025, 1
2817.958 PM
Severity
Logger
livekit.plugins.silero
Message
inference is slower than realtime
Attributes
{delay: 13.753095978001308
code.file.path: "/home/appuser/.local/lib/python3.11/site-packages/livekit/plugins/silero/vad.py"
code.function.name: "_main_task"
code.line.number: 397n
room_id: "RM_5oNDScCsHvX8"
job_id: "AJ_zbYsRjndG4zK"
logger.name: "livekit.plugins.silero"
}