Hey all! I am building a voice agent for conversat...
# agents
c
Hey all! I am building a voice agent for conversations in local languages, such as Hindi, Punjabi, and Tamil. As far as I have seen, the turn_detection only supports major languages like English, hindi, french, etc. I have two questions: 1. Is there a way to use turn_detection with local languages? If not, I have to rely on VAD alone... 2. If I have to go to VAD, is there a way to pass the language in metadata and use turn_detection when it's a supported language, and opt out when it's not? As turn_detection throws an error for an unsupported language... Is this runtime change viable?
l
1. The multilingual turn detection model will work with Hindi, but for Punjabi and Tamil you would have to use VAD. 2. It depends on your STT, but most STT will not report the detected language on the fly, so you would need to configure this beforehand, or determine it during the call e.g. by using LLM
c
can i disable turn_detection conditionally?
l
You should be able to use
session.update_options
Enable:
session.update_options(turn_detection=MultilingualModel())
Set to VAD:
session.update_options(turn_detection="vad")
👀 1