Hi, we upgraded to livekit agents 1.3.6 and notice...
# agents
c
Hi, we upgraded to livekit agents 1.3.6 and notice that when using ElevenLabs or LMNT TTS with ‘preemtive generation’ that TTS stream is really stuttering or sounds like it’s really trying to push. Before this we had 1.2.18 and there were no issues with preemtive generation. Is this known by the team by any chance? It happens specifically with Deepgram as STT, but also with Soniox.
q
Can i see your AgentSession code so I can set up and see ?
c
@quaint-ambulance-32873
_await_ session.start(
_agent_=agent_class,
_room_=_ctx_.room,
_room_options_=room_io.RoomOptions(
_text_input_=room_io.TextInputOptions(
_text_input_cb_=handle_text_input,
),
_audio_input_=room_io.AudioInputOptions(
_noise_cancellation_=noise_cancellation.BVC(),
), ), ) Is this sufficient?
q
Do you have a constructer where you defined all the stt, tts, llm configurations?
c
We load the TTS, STT and LLM dynamically, so when the session starts the STT, TTS and LLM models are loaded through config that we store, this happens prior to the agent session being started
✅ 1
What I notice is that with preemtive generation on, it’s quite random, sometimes it goes ok, sometimes it goes good, but many times it stutters. I also read that this is a known issue with preemtive generation, is that correct?
q
Let me have a look into this and get back to you
c
Thanks
Hmm I am seeing this also happen now without Preemtive generation disabled, need to investigate a bit further, that TTS stream sometimes sounds stuttery
Somehow this issue is new. We have currently agents 1.2.18 deployed on production and staging, no issues there. But the issue is there with agents version 1.3.6 on our dev environment
✅ 1
q
I can not seem to replicate the issues locally (region can also be a factor here, i am based in europe), but I would suggest looking at the observability insight to understance the traces https://docs.livekit.io/agents/observability/,
c
Thanks Karison for testing, I am based in EU as well. We have implemented Tempo for traceability ourselves and see nothing there, I have done around 50+ calls just now and somehow it is now resolved. Wondering if it might have been a phone connection issuer
Thanks for checking out
q
interesting, if you have any more information, feel free to share them
c
Will do, we are keeping in eye on it
m
We've had a similar problem, and it's very sporadic. Our users say that it sounds like the AI is speaking in gibberish, or is elongating vowel sounds for a very long time. I don't have any solutions, and I've reached out to ElevenLabs support, but haven't gotten anything useful so far Nothing new to add, but just wanted to say that I'm experiencing this as well!