I would like to know how to integrate LiveKit with the OpenAI Assistant API. The Assistant API has a Knowledge Base feature and I would like to utilize it. If you know of any resources or repositories, please help. Thank you.

It seems likely that integrating LiveKit with the OpenAI Assistant API can be achieved using the LiveKit Agents framework, which supports OpenAI's Realtime API. This framework allows for building conversational applications and can be extended to include features like a Knowledge Base. According to the LiveKit Docs, you can use the Agents framework to create multimodal AI agents that can interact with users in real-time. For utilizing a Knowledge Base, you might consider using function calling capabilities within the LiveKit framework. As per the LiveKit Slack discussion, you can set up a function call in the assistant class to interact with a knowledge base vector store. This involves defining a

FunctionContext

and providing it to the

VoiceAssistant

. Would you like more detailed guidance on setting this up? Sources: - LiveKit Docs - LiveKit Slack discussion 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.

@millions-hair-24956 I want Asisstant API not Realtime API