Does inference run only in us-east? any chance I can get access to an ap-south instance? I plan on deploying the agent worker in ap-south...would be great if inference is close by
r
rough-gpu-50664
10/30/2025, 4:43 AM
Our inference service is deployed at every one of our global clusters. You're all set.
m
modern-restaurant-53740
10/30/2025, 4:44 AM
OK. so if just the agent is in ap-south then all traffic is local?
r
rough-gpu-50664
10/30/2025, 4:47 AM
No. The current version of the gateway is a router. We send the requests to the providers.
We are exploring ideas around future versions where we host models so everything stays local, but we don't have a timeline for it yet.
rough-gpu-50664
10/30/2025, 3:37 PM
let me know if you have other questions. I hope that clarifies things but I'm not entirely sure I understood your question.