https://promptfoo.dev/ logo
Potential bug - gemini live provider with audio mo...
# ❓|questions
c
My real environment is audio-to-audio with gemini 3.1 flash live model with multi turn conversation. I want to use promptfoo to simulate the conversation (
promptfoo:simulated-user
). 1. Is it possible to let
promptfoo:simulated-user
to do an audio-to-audio conversation with
gooogle:live:gemini-3.1-flash-live-preview
and run assert to validate the quality? 2. If not, do you know if using
response_modalities: ['text']
yields similar output? If output will be similar, i'm okay using text modality **Update**: I can't connect to
gooogle:live:gemini-3.1-flash-live-preview
at all even with
promptfoo init --example google-live-audio
. - In text modality, I get
WebSocket connection closed unexpectedly. Code: 1011, Reason: Internal error encountered.
. - In audio modality, I get
[ERROR] WebSocket request timed out
(
google:live:gemini-2.5-flash-native-audio-preview-12-2025
works fine)