While using Livekit Inferences, we are getting very unstable LLM TTFT which is ranging from 300ms to >5s. This is happening with over 20% of the calls right now. The Agent is deployed in LiveKit Cloud. Is there a way to mitigate this? Can we have something which is stable. The two models that I've used is gpt-4.1-mini(openai) and the other is kimi-k2 (baseten). Any help regarding this is much appreciated.

Do you have agent insights enabled? If so can you share a sample session where you are seeing the longer response times?