`**************** IMPORTANT BLOCKER -- NOT GETTING...
# agents
m
**************** IMPORTANT BLOCKER -- NOT GETTING PROPER SUPPORT SINCE 5 DAYS **********
Is there anyone at LIVEKIT Support who can really take cognizance of the issue I and my team has been raising since 4-5 days?? Request someone to please reply. I jsut sent a follow up email to support with whom back and forth is happening but the response time hugely delayed. They jsut keep asking for logs and then vanish. We are an AI Hiring platform with digital twins of recruiters (https://www.jobtwine.com/) and are integrated with an avatar provider BeyondPresence @few-truck-68216 @echoing-intern-92777 and team !! Since last week we have been facing the avatar NOT responding issue in the middle of the conversation. And all we are hearing from livekit support is to keep providing them logs so they can dig but response time is slow --- Based upon deeper analysis by us and Beyond Presence, there is an issue at Livekit agent cloud where it is not doing an audio push to BeyondPresence resulting in avatar not speaking up even though every other layer is functioning well. We have requested multiple times to come on call so us, Livekit and BeyondPresence (BP) engineers cna sit and do quick troubleshooting together. As per BP, this is the root cause: *`**************** PLEASE REPLY SOMEONE at LiveKit ***************`*
@refined-appointment-81829 @rough-gpu-50664 @best-notebook-41164
j
seeing multiple
clear_buffer
but no
push_audio
it sounds like the agent is trying to interrupt the speech and expecting a
playout_finished
event from the avatar. basically the agent expect a playout finished event for each pushed audio segment. when there is a miss match, the agent don’t know if the previous speech is done, and will try to send the interruption signal (i.e.
clear_buffer
) and wait the speech done before a new speech starts.
that’s why you didn’t see a
push_audio
and the agent not speaking anymore
r
Reproduce locally with this code: https://github.com/livekit/agents/tree/main/examples/avatar_agents/bey and then provide steps and any changes to that code you make with how to reproduce. Then can have someone take a look.
j
created a fix https://github.com/livekit/agents/pull/3917 to adding a timeout for the playback finished event
🙏🏼 1
b
@mammoth-plastic-7941 - let us know if this fix solves the issue for you
m
Thanks @best-notebook-41164
and @jolly-air-155 --- My team will pull the PR and test it on Friday. Glad that we came to a more logical conclusion. We still feel this may fail or may result in situations where clearbuffer also fails on avatar side for some reason.... we are still reviewing and will share --- but let us know what you think. @enough-dentist-75383 @high-librarian-24874 @helpful-alarm-92181
@few-truck-68216 @echoing-intern-92777 Tagging you....
@jolly-air-155 @best-notebook-41164 Plz share when this goes to prod ? We’d really like this to be deployed asap plz as I had mentioned it’s a blocker
r
Did that fix the issue for you?
Also, I know you are in communication with Bey on the issue, were you able to convince them to resolve the root cause and send the
playout_finished
event?
m
We talked to Bey team --- they are looking into it. We haven't tested on local yet. It is tough to tet on local and replicate as its not a very consistent issue. When we deploy on cloud and test across multiple individuals testing together, the probability of this issue increases quite bit
@jolly-air-155 @refined-appointment-81829 Is there a timeline to deploy to main release? Can't this be deployed as a hotfix?
r
Why hotfix? It is already merged to main and will be in the next release.
m
Wilson - when is next release ? For you this may be one fix , for us this is a BLOCKER ….
So that’s why asking
@best-notebook-41164 ?
l
We hope to release a new version sometime early next week, if not earlier