Hi! I can help with this. From your setup, the delay is most likely coming from buffering and serialization inside the Python agent layer rather than Gemini itself, especially since direct API tests are fast. Running the agent locally can also add extra round-trip and processing overhead compared to deploying it in the same region as LiveKit. With proper tuning of frame sizes, streaming chunk relay, and LiveKit/Unity jitter buffer settings, it’s usually possible to bring response start time closer to the 1–1.5s target. I’d be happy to help profile the pipeline end-to-end and optimize each stage for lower latency.
@green-area-83933