strong-holiday-45326
03/03/2026, 9:29 PMtall-airline-16756
03/03/2026, 9:29 PMtall-airline-16756
03/03/2026, 9:30 PMdef prewarm(proc: JobProcess):
proc.userdata["vad"] = silero.VAD.load()
server.setup_fnc = prewarm
• Prewarming ensures shared objects (VAD, STT, TTS, LLM clients) are ready and reused across sessions, avoiding per-connection model load cost.
1. Pre-download model files during container build
◦ Add a step in your Dockerfile to download large model files at build time:
RUN uv run src/agent.py download-files
• This prevents runtime network/model-download latency when containers start.
1. Right-size and monitor your deployment
◦ Ensure your deployment has sufficient capacity so LiveKit Cloud can keep the workers warm. Monitor warm-worker availability and startup latency and adjust sizing if needed.
If you want, I can:
• Walk through where to enable cold-start prevention in your current deployment config.
• Review your agent startup code (or Dockerfile) and point out exactly where to add prewarm/download steps.
• Suggest what to prewarm first (e.g., VAD, STT) based on which features you use.
Which would you like help with next? If you share your deployment type (LiveKit Cloud plan) and a short snippet of your agent startup or Dockerfile, I’ll give targeted instructions.
Sources: How to match the latency of the homepage agent | LiveKit | How much can LiveKit scale? | LiveKit | Collect recording consent with tasks | LiveKit Documentation | Silero VAD plugin | LiveKit Documentation | VAD Metrics | LiveKit Documentationstrong-holiday-45326
03/03/2026, 9:41 PMtall-airline-16756
03/03/2026, 9:41 PM