This message was deleted.

Yes, you can only expose one inference API endpoint for now. Are you looking for expose all inference API endpoints through Sagemaker?

Hi Bo, thanks for the response. We are testing out each of the different deployment options to gauge which suits our use case the best. It seems like deploying to Lambda with a docker container will be the best for us, but I believe the functionality is still being built into BentoML. Is this correct?

Hey Ryan, would you able to describe your use-cases, so we can help you figure out which one fit you better? Yes, you are correct, we are in the process of implementing container support for Lambda. Currently Azure Function (similar to Lambda) has container support. If you are using Azure cloud, this is something I would recommend.

Hi @Bo, thank you again for this great response! Unfortunately, I cannot speak to the use case in depth because I am new to the team and do not have to the knowledge yet. My role is exploring the model serving options that are available and how they integrate into Azure/AWS etc. Yes, I see that Azure Function has a painless deployment, we will look into that further! Furthermore, it really wasn't much work to deploy a containerized saved Beno Service to Lambda as the bento codebase is so well written - thank you!