Hi everyone! I am part of a team putting together an educational mobile app for iOS and Android. As part of that, we are self-hosting LiveKit and using the app-side SDK to operate real-time avatars for learning. It works, but we’ve hit a lot of snags with performance. A lot seems like we just aren’t totally understanding how to get the app to talk to the server correctly. Everything looks like it “should” work, but there are frequent unexplained gaps and sometimes it feels like it works “by accident.” Has anyone been through this route and able to advise? We’ve factored the avatar part of the app into an internal SDK (and deployment), so the LiveKit part is pretty well isolated. As expected, a lot of APIs are involved to get the speech, ASR etc. to work.

Is the problem only when using the app? Did you try the avatar on the web?