This message was deleted.

I believe cloud native is exactly what you need. And bentoml has provided Yatai and BentoCloud, both built on top of k8s. Yatai is a community-driven version that allows users to centrally manage bentos and their deployment in a k8s cluster if one already exists. BentoCloud is a hosted version suitable for teams who do not want to manage k8s themselves and includes serverless functionality to further increase scaling possibilities. If you have more detailed questions, I can also answer them.

This sounds like the path forward for us. As far as I understood, in our scenario runner or collection of runners become the unit of deployment in a k8s clusters and service layer becomes another unit of deployment in separate k8s cluster. Can you point me to some specific documentation/example for this scenario? Also would like to get some details on BentoCloud, specially on pricing model to explore the possibility of hands free infrastructure management for our scenario.

Hi @Sudeep Ghimire! Would you mind grabbing a call to discuss? I'd like to ask a few more questions about your runner setup. Want to make sure if there's a feature gap or not and what solutions we could explore. I'll send you a dm

Sounds great and really appreciate it. Tomorrow is a great day for me to schedule a call.