Join Slack
Powered by
Any estimates as to performance improvements (redu...
# inference
m
many-hair-70963
10/02/2025, 2:17 PM
Any estimates as to performance improvements (reduced latency) when leveraging LK inference especially when using avatars?
r
rough-gpu-50664
10/03/2025, 5:17 AM
Is your agent hosted on LiveKit? you'll get latency improvements for STT-LLM-TTS, which are upstream of the avatar call. We don't directly support avatars in our inference service. But your end to end latency should improve because the inference service improves latency upstream of the avatar call. For self hosted agents, see my response here.
https://livekit-users.slack.com/archives/C09J2AYGN0M/p1759468506841849?thread_ts=1759355716.866269&cid=C09J2AYGN0M
Open in Slack
Previous
Next