This message was deleted.

Yes, we built Yatai just for that https://github.com/bentoml/Yatai

Is there a tutorial or reference you could point me to?

Here’s the documentation for Yatai: https://docs.bentoml.org/projects/yatai/en/latest/ it might be a bit hard to set up if you are new to kubernetes

Hmm but one thing I'm wondering if there is an easy way to accomplish this on EC2?

You can use EKS on AWS and follow the instructions. Better yet, please check out their Bento Cloud solution. It will save you a lot of MLOps time.