Hey, I’m new to BentoML. I’m using it for building a Docker container and deploy it to K8s using a regular Deployment. In this setup, is it possible to use Distributed Services (https://docs.bentoml.com/en/latest/guides/distributed-services.html) using

bentoml.depends

, or it’s something that works only in Bento Cloud? (At the moment I’m less worried about setting different resources and replicas for the different services. It’s ok if it ends up getting deployed as a single Deployment with the main endpoint exposed)

For single deployment - yes! you can use

bentoml.depends

to specify multiple models. You can deploy the container generated with BentoML and different models(bentoml services) will just run in different process groups within one container/pod in your k8s deployment.

Great, thanks!