Does inference run only in us-east? any chance I c...
# inference
m
Does inference run only in us-east? any chance I can get access to an ap-south instance? I plan on deploying the agent worker in ap-south...would be great if inference is close by
r
Our inference service is deployed at every one of our global clusters. You're all set.
m
OK. so if just the agent is in ap-south then all traffic is local?
r
No. The current version of the gateway is a router. We send the requests to the providers. We are exploring ideas around future versions where we host models so everything stays local, but we don't have a timeline for it yet.
let me know if you have other questions. I hope that clarifies things but I'm not entirely sure I understood your question.