Hello @everyone @channel @here, I recently started exploring BentoML to see how it could help improve our company’s ML infrastructure and reduce operational hassle. However, I encountered a challenge: I’m looking for a resource that explains how to easily deploy a model to AWS Lambda functions. Unfortunately, I haven’t been able to find any comprehensive guides or documentation on this. I did come across a GitHub repository that seemed relevant, but it was archived due to the deprecation of BentoCTL. Does anyone know of any other resources, even within the official documentation, that detail how to deploy BentoML models on AWS Lambda? Any help would be greatly appreciated!

Hi Ntchinda, you can use BentoML with AWS lambda by following Lambda’s guide, and make sure add the required endpoints and set the entrypoint with lambda. However you’ll miss out many features in BentoML that won’t be possible on lambda due to its limitations (also why we eventually decided to deprecate it)

Thank you for your intervention. When you mention “Lambda’s guide,” are you referring to AWS Lambda itself or the BentoML documentation regarding it?

I mean AWS’s guide

Thanks a lot.