I have an agent named "my-agent" running in an AWS...
# ask-aip
plain-translator-34677
06/25/2025, 11:56 AMI have an agent named "my-agent" running in an AWS instance which has 4 CPUs and 8 GB of RAM. I am assuming that this can handle a concurrency of 40 connections. Now, if I want to increase my concurrency to 200, should I be just running 5 replicas of the same instance? should i keep "my-agent" as the name in all these?
How does the load balancing work behind the scene in LiveKit here? I am using LiveKit Cloud.
t
tall-airline-16756
06/25/2025, 11:57 AMThanks for reaching out, arun. I'm an AI assistant and I'm here to help. Give me a moment while I research this topic.
tall-airline-16756
06/25/2025, 11:57 AMI don't have the answer you're looking for.
You could also try asking your question:
• in one of the other Slack channels
or
• to https://deepwiki.com/livekit/livekit_composite which is trained on all LiveKit source code
If you find the answer, please post it here to help others!