How to detect at which point of the agent speech t...
# ask-aif
flaky-hospital-13625
08/11/2025, 11:52 PMHow to detect at which point of the agent speech the user interrupted, so that agent can repeat what was missed
t
tall-airline-16756
08/11/2025, 11:52 PMThanks for reaching out, Amjad. I'm an AI assistant and I'm here to help. Give me a moment while I research this topic.
tall-airline-16756
08/11/2025, 11:53 PMHey there! To catch when a user interrupts the agent's speech and help the agent repeat what was missed, you can use LiveKit's APIs like this:
• Listen for Interruption Events: Keep an ear out for the
AGENT_SPEECH_INTERRUPTEDagent.on(VPAEvent.AGENT_SPEECH_INTERRUPTED, (msg) => { console.log('Agent was interrupted:', msg); });PlaybackFinishedEventdef handle_playback_finished(event): if event.interrupted: playback_position = event.playback_position print(f"Interrupted at position: {playback_position} seconds")SpeechHandlesay()generate_reply()ChatContextf
flaky-hospital-13625
08/11/2025, 11:55 PMShare examples for python. Also does chat ctx contain reference to where the agent stopped or the entire speech.
t
tall-airline-16756
08/11/2025, 11:56 PMHey there! Here are some Python examples to help you detect interruptions and smoothly resume agent speech in LiveKit:
1. Basic Interruption Detection
Copy code
import asyncio
from livekit.agents import AgentSession
from livekit.agents.voice.events import UserInputTranscribedEvent
async def detect_interruptions():
session = AgentSession(allow_interruptions=True)
@session.on("user_input_transcribed")
def on_user_input(event: UserInputTranscribedEvent):
if event.is_final and len(event.transcript.strip()) > 0:
print(f"User said: {event.transcript}")
@session.on("conversation_item_added")
def on_conversation_item_added(event):
if event.item.interrupted:
print(f"Agent was interrupted. Partial speech: '{event.item.text_content}'")
await session.start() Copy code
async def resume_after_interruption(session):
last_message = session.history.items[-1] if session.history.items else None
if last_message and last_message.interrupted:
print(f"Resuming from interrupted speech: '{last_message.text_content}'")
await session.say(f"Let me continue: {last_message.text_content}")ChatContextChatContextinterrupted=True