Hi! Just wondering if there’s a way to deploy bent...
# ask-for-help
l
Hi! Just wondering if there’s a way to deploy bentoml with sagemaker. Just realized “bentoml/aws-sagemaker-deploy” is deprecated, but i need to deploy the model with bentoml on sagemaker. If anyone can provide any guidance that would be great!
👀 1
m
I have the same question. The documentation dont provide any guidance on this. Is there any information on how to migrate from the deprecated bentoctl-sagemaker setup to an equivalent setup?
j
The idea is that you will build a docker container with
bentoml containerize
and deploy that by yourself to sagemaker. https://docs.aws.amazon.com/sagemaker/latest/dg/your-algorithms-inference-code.html The project is deprecated because bentoml is a fast iterating project and it is not feasible for the team to maintain integrations with all kinds of serving platform. Instead, we provide the flexibility to user to do that because the unit of distribution of a bento is a docker image
m
Hi Jian, thanks for the reply. Is there any guide or tutorial that sets something like this up?
The problem with SageMaker is that a deployable image should follow a very strict structure, implementing a serve executable and handler code etc. I am new to bento so I don't have a clear idea of how much work would be left (if I want to deploy to a SageMaker Endpoint using bento)