Is it possibile to start a session with a realtime...
# ask-aif
few-soccer-7112
07/10/2025, 9:53 PMIs it possibile to start a session with a realtime agent (possible nova sonic), then switch to a voice pipeline agent once it enters a specific node?
t
tall-airline-16756
07/10/2025, 9:53 PMThanks for reaching out, Muthana. I'm an AI assistant and I'm here to help. Give me a moment while I research this topic.
tall-airline-16756
07/10/2025, 9:54 PMIt is possible to start a session with a realtime agent (such as Nova Sonic) and then switch to a voice pipeline agent when the session enters a specific node. LiveKit supports agent handoff within a session using several mechanisms:
• Function tool-based handoff: You can define function tools that, when invoked, return a new agent instance, automatically transferring control. This lets the logic of your workflow (such as reaching a certain node or condition) trigger the agent switch.
• Direct agent switching: You can mix realtime agents (like Nova Sonic) and traditional voice pipeline agents in the same session. Each agent can be customized with its own models and instructions, and you can swap between agents depending on your workflow.
• Node-based customization: The framework allows you to define transitions at specific nodes. Nodes represent points where different processing (STT-LLM-TTS pipeline or realtime) can be swapped in or out. You can use lifecycle hooks (such as
on_enteron_exitswitch_to_pipelinef
few-soccer-7112
07/10/2025, 9:55 PMshow me an example of node-based customization
t
tall-airline-16756
07/10/2025, 9:57 PMHey there! Let me walk you through a super cool way to customize your agents in LiveKit. Think of this like giving your agent a personal touch when it starts or switches roles. It's kind of like how you might greet someone when you walk into a room or say goodbye when you're leaving.
Copy code
class VoicePipelineAgent(Agent):
def __init__(self):
super().__init__(
instructions="You are now using a voice pipeline",
stt=deepgram.STT(),
llm=openai.LLM(),
tts=cartesia.TTS(),
)
async def on_enter(self):
# Custom logic when this agent becomes active
await self.session.say("I've switched to the voice pipeline agent")
async def on_exit(self):
# Custom logic before handing off to another agent
await self.session.say("Exiting the voice pipeline agent")on_enteron_exit