Quick summary:
- Using livekit-agents==1.3.9 and livekit-plugins-xai==1.3.9
- Tried two approaches:
a. xai.realtime.RealtimeModel(instructions="...") → TypeError: unexpected keyword argument
b. Agent(instructions="...", llm=xai.realtime.RealtimeModel()) → starts fine, but Grok completely ignores the system prompt
What's weird: The exact same pattern works perfectly with OpenAI Realtime. Instructions get forwarded properly and the model follows the prompt as expected.
Current behavior: Grok just uses its default personality regardless of what we pass to Agent.instructions. It's like the instructions never make it through the plugin to the xAI API.
Is this a known limitation, or are we missing something in how xAI needs to be configured? Happy to provide more details