square-ambulance-42553
04/15/2026, 7:34 AMtall-airline-16756
04/15/2026, 7:34 AMtall-airline-16756
04/15/2026, 7:35 AMsquare-ambulance-42553
04/15/2026, 7:35 AMtall-airline-16756
04/15/2026, 7:35 AMsquare-ambulance-42553
04/15/2026, 7:36 AMtall-airline-16756
04/15/2026, 7:36 AMsquare-ambulance-42553
04/16/2026, 6:37 AMtall-airline-16756
04/16/2026, 6:38 AMsquare-ambulance-42553
04/16/2026, 6:40 AMsquare-ambulance-42553
04/16/2026, 6:41 AMtall-airline-16756
04/16/2026, 6:41 AMroom_name or room_prefix, and specify an agent_name to be dispatched to that room.
• However, a single agent process/job can only join one room at a time. To have the same logical agent present in multiple rooms simultaneously you must run multiple instances (separate jobs/processes) of that agent; dispatch rules and scaling your agent servers enable that.
Would you like help creating a dispatch rule or guidance on scaling agent instances?
, with interactive elementssquare-ambulance-42553
04/16/2026, 6:45 AMtall-airline-16756
04/16/2026, 6:46 AMagent_name. Each process handles one room at a time, and the dispatcher distributes rooms across instances.
How to scale (high level)
1. Horizontal scaling
◦ Start more agent server instances (or more worker processes) using the same agent_name. The dispatcher treats them as interchangeable workers and assigns new rooms to available instances.
1. Configure load management
◦ Use load_fnc and load_threshold on agent servers so the dispatcher knows capacity (default uses CPU; default threshold ~0.7). Tune thresholds to match your autoscaling policy.
1. Autoscaling
◦ Autoscale agent servers by CPU (or your chosen metric). Scale up at a lower threshold than load_threshold (e.g., scale up at 0.5 if threshold is 0.7) to avoid rejecting jobs under sudden load.
1. Capacity & resources
◦ Start with ~4 CPU cores and 8GB RAM per agent server as a baseline; one server typically handles ~10–25 concurrent jobs depending on workload.
1. Graceful draining
◦ When removing instances, allow existing jobs to complete (use SIGTERM/SIGINT handling and a 10+ minute grace period for voice apps).
LiveKit Cloud vs self-hosted
• LiveKit Cloud handles load balancing and elastic placement for you.
• Self-hosted requires you to run multiple servers/processes and configure autoscaling and load thresholds.
If you want, I can:
• Give a sample deployment approach for Kubernetes or Docker.
• Recommend specific autoscaling settings based on your expected concurrency and CPU profile.
Which would you like next?
Sources: Self-hosted deployments | LiveKit Documentation | Avoiding crosstalk when multiple developers share a LiveKit project | LiveK... | Voice Agent Architecture: STT, LLM, and TTS Pipelines Explained | LiveKit | Agents Framework | livekit/livekit_composite | DeepWiki | Deploy and scale agents on LiveKit Cloud | LiveKit, with interactive elements