@millions-hair-24956 Hey all, I've been trying to build an VoicePipelineAgent with gemini, whenever a function call is executed, I get an error

livekit.agents._exceptions.APIStatusError: gemini llm: client error (status_code=400, request_id=e2507bdc00a2, body=Invalid JSON payload received. Unknown name "id" at 'contents[3].parts[0].function_call': Cannot find field.
Invalid JSON payload received. Unknown name "id" at 'contents[4].parts[0].function_response': Cannot find field.)

This happens even when trying out just the simple demo at https://github.com/livekit/agents/blob/main/examples/voice-pipeline-agent/gemini_voice_agent.py My package versions are livekit=0.20.3 livekit-agents=0.12.15 livekit-plugins-google=0.10.5 livekit-plugins-silero= 0.7.4

It seems likely that the error you're encountering is related to the JSON payload structure expected by the Gemini LLM. The error message indicates that the fields "id" in 'function_call' and 'function_response' are not recognized, suggesting a mismatch between the expected and provided JSON structure. This could be due to changes in the API or the way the function calls are being handled in the code. My understanding is that you are using the example from the LiveKit GitHub repository, which should be compatible with the versions you mentioned. However, the error suggests there might be an issue with how the function call data is being formatted or sent to the Gemini LLM. It might be helpful to check if there are any updates or patches for the LiveKit plugins or the Gemini LLM that address this issue. Additionally, reviewing the LiveKit documentation for any changes in the API or function call handling might provide further insights. Would you like more detailed guidance on troubleshooting this issue? Sources: - LiveKit GitHub repository - LiveKit documentation 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.

@millions-hair-24956 what Livekit Plugin version should I use?

I'm not able to find any data sources to answer your question. Please specify which Livekit Plugin you are referring to, as there are multiple plugins available for different functionalities. If this doesn't help, please reach out to the Livekit support team for further assistance. 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.