The Retell Community is where innovators, call center leaders, and AI enthusiasts come together to share ideas, learn best practices, and explore the future of voice automation. Join to connect with peers, get early access to product updates, and collaborate on building human-like AI voice experiences that transform customer service.

Retell AI

<@1145576664366055464> , cant i use custom llm anymore?

Thanks for tagging me <@1347120295416430612>. I'll look through relevant sources and get back to you shortly.

### Answer
 

Yes, you can still use Custom LLM with Retell AI. [(1) ](<https://docs.retellai.com/api-references/llm-websocket>) The Custom LLM integration is fully supported through the LLM WebSocket. 

Retell AI connects with your server and gets responses/actions from your custom LLM. When starting a call, Retell AI will initiate the WebSocket connection to your server endpoint at `{your-server-websocket-endpoint}/{call_id}`. 

The documentation notes that "Retell agent frameworks like single prompt, conversation flow provides more capabilities and built in tool sets. We recommend using those frameworks if possible. Only use custom LLM integration if you have to due to specific compliance or use case requirements." 

For implementation guidance, you can follow the Custom LLM Integration Guide for step-by-step instructions. [(1) ](<https://docs.retellai.com/api-references/llm-websocket>) [(2) ](<https://docs.retellai.com/integrate-llm/integrate-function-calling>)

​
To learn more, see the sources I considered:

[[1] LLM WebSocket](https://docs.retellai.com/api-references/llm-websocket)
[[2] Integrate Function Calling](https://docs.retellai.com/integrate-llm/integrate-function-calling)
​

Feel free to tag <@1145576664366055464> with additional questions. I also appreciate feedback, it helps me improve.