Hi, I'm facing issue with TTS lag Issue: LLM gene...
# agents
r
Hi, I'm facing issue with TTS lag Issue: LLM generated response -> "Generating Your Image" but TTS is not happening until response completed at last when i receive image generation details impacting experience there is a pause of around 2 mins between "Generating Your Image" and receiving final response Goal: Start TTS as soon as i receive LLM response
b
Looking for similar behavior please let me know if you find any solutions to this.
m
Hey @rough-greece-29243, so i assume it's a synchronous process thats happening, i mean the image generation part. And the agent responds after that is completed. Is this a tool call thats doing the image generation process?
j
Look at using session say on the tool call https://docs.livekit.io/agents/build/tools/#overview
r
@many-fall-81099 No tools call made via lk agents, directly calling CustomLLM backend Issue seems to be intermittent Works 1 out of 10 times I can see llm response inside event channel in Llm Stream
b
@rough-greece-29243 were you able to find anything regarding this?
m
Need a bit more understanding...is generating image firing a synchronous function somewhere? which is taking 2 mins complete
r
No i'm directly calling LLM without any function call
j
Just to understand what’s the driving decision to not use a tool in this case ?
b
@jolly-house-35439 I had the same issue. I am using LLMAdapter that wraps a Langgraph's Graph and prodcues text on different interval(Agents work and give outputs)
m
@rough-greece-29243 Interesting. Have u tried switching to proprietery llm providers, like openai to see if its the same behavior?
r
@many-fall-81099 Yes, we tried OpenAI LLM, didn't found issue coz it responded quickly with no pause But, issue arise when there is a pause in between response chunks
can you share what all more information is needed to help investigate the issue or what we can investigate ourself
@many-fall-81099 @jolly-house-35439 We are still facing this issue. Could you please look into it and help us resolve it?