This message was deleted.

Yes! Deploying LangChain + OpenAI apps with BentoML: blog: https://towardsdatascience.com/deploy-a-voice-based-chatbot-with-bentoml-langchain-and-gradio-7f25af3e45df code: https://github.com/ssheng/BentoChain A more complicated example to bring Microsofts’ VisualChatGPT (TaskMatrix now) to distributed deployment with BentoML https://github.com/bentoml/Distributed-Visual-ChatGPT/tree/main/bentoml We’ve also just launched a new project OpenLLM, if you are looking to self-host your own LLMs: https://github.com/bentoml/OpenLLM