Hi,
We are using a RPC request to trigger the generate_reply function to make our agent start the conversation with the user. Works great for openai Realtime but when using Gemini we do not get it to work. (we are using "gemini-2.5-flash-native-audio-preview-09-2025" )
We can see from the model's internal reasoning dialog in the transcription that the message gets received, but the actual reply never gets sent from the model.
And then when the user asks something then the agent answers and the conversation starts.
I have seen some threads here in slack of issues with generate_reply function for gemini but this far no solution has helped for us.
We get this error message - when we look in the agent observability
Error in _realtime_reply_task
exception.type: "RealtimeError"
exception.message: "generate_reply timed out waiting for generation_created event."
exception.stacktrace: "Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/livekit/agents/uti..."
And the attached in frontend.