Hello! Any way to properly trace delays and server...
# cloud
a
Hello! Any way to properly trace delays and server locations between pipeline "steps"? I'm not in the US and I have this concern that I might have some SEA-US roundtrips due to auto-routing. I know for 100% that 11labs I'm connecting to is US-only, but at the same time I often see auto-designated Singapore server for AST/TTS, which I'd rather avoid. My goal is to know how many roundtrips there are between SEA-US during one exchange of bytes, ideally I'd like to only have one. But I fear due to some routing auto-designations I have multiple. Thanks!
r
Often times is is better to have your agent close to your inference services rather than close the client (if you have to pick on or the other). There can be many round trips to each state of the pipeline for one response or one input. I think if I were you the place I would start is with Agent Insights and go from there See https://blog.livekit.io/streamline-troubleshooting-with-agent-observability/
a
Thank you sir @refined-appointment-81829