can we force and set the user state to away?

Thanks for reaching out, Sebastián. I'm an AI assistant and I'm here to help. Give me a moment while I research this topic.

and to update the system instructions mid session of the Realtime model?

I'm happy to help you with updating system instructions mid-session in the Realtime model! Here’s how you can do it using your SDK: • Python SDK: Simply use

await agent.update_instructions("New system instructions here")

to update your instructions on the fly. • JavaScript SDK: You can call

await session.updateInstructions("New system instructions here")

to send the updated instructions through the

session.update

event. Just a quick note about how this works depending on your provider: • OpenAI: You’re in luck! It supports smooth mid-session updates without needing to restart. • Google (Gemini): You might need to restart the session to see the changes take effect. • Ultravox: It’s important to mark the session for restart when you update instructions. If you have any questions or want me to walk you through the implementation, please don’t hesitate to ask. I’m here to help! Sources: agents/src/llm/realtime.ts | livekit-agents/livekit/agents/llm/realtime.py

and to clear the session chat context?

To help you clear the session chat context in the LiveKit Realtime model, you can simply use the

update_chat_ctx

method with an empty

ChatContext

. This will gently reset the conversation history for your session, giving you a fresh start. Here’s a friendly example in Python to guide you:

from livekit.agents.llm import ChatContext

# Assuming you have a reference to your RealtimeSession
await realtime_session.update_chat_ctx(ChatContext.empty())

This method works smoothly across various providers like OpenAI, Google, AWS, and Ultravox. If you’d like, I’m here to help you with any part of the implementation or answer any questions you have! Sources: livekit-agents/livekit/agents/voice/agent_activity.py | plugins/google/src/beta/realtime/realtime_api.ts