This message was deleted.
# announcementss
Slackbot
09/26/2020, 1:15 PMThis message was deleted.
🎉 5
h
Hirako Sa
09/26/2020, 1:18 PMI experimented with most of the AI pipeline solutions out there, days of deployment and tests to revamp our existing, painful and slow existing SDLC process. We wanted to be able to ship models to production faster and throw experimental, canary instances to evaluate their prediction quickly, against production data.
Hirako Sa
09/26/2020, 1:20 PMBentoML is by far the most well thought design of all. It doesn't get in the way yet does what it's meant to do well. It's also the most robust/versatile. Kubeflow/Kserving were promising but ironically can't even be deployed on the latest version of k8s.
👍 3
🎉 4
Hirako Sa
09/26/2020, 1:22 PMI was able to create a build + deploy pipeline to our clusters, with canary instances in about a day or so.
I had to come in here and say thanks!
🙏 1
c
Chaoyu
09/26/2020, 5:22 PMThank you for sharing, Hirako! Really glad to hear about it!
Chaoyu
09/26/2020, 5:27 PMWe see the pain points in adopting Kubeflow/KFserving for model deployment and we are actually building a model orchestration layer for bentoML on Kubernetes. I will keep it posted on our progress here in the community.
👍 2
h
Hirako Sa
09/26/2020, 8:41 PMit's rather easy to orchestrate as it stands. the Networking aspect works well with existing solutions e.g knative/istio.
Hirako Sa
09/26/2020, 8:48 PMin the roadmap, I see:
Advanced model deployment workflows for Kubernetes, including auto-scaling, scale-to-zero, A/B testing, canary deployment, and multi-armed-bandit
The first 4 features are not pain points. But the last one is interesting. Right now we have to build our own strategy.
c
Chaoyu
09/29/2020, 3:54 PMThanks for the feedback @Hirako Sa may I ask how do you currently do A/B testing and Canary deployment? Was it operated by a DevOps team?
h
Hirako Sa
09/30/2020, 3:47 AMwe didn't have A/B testing/canary deployment until now. Now using knative with its revision system.
Hirako Sa
09/30/2020, 3:54 AMin our case, the data science team is the devops team. we don't have dedicated deveops roles. Of course not everyone is looking at the devops aspect.
👍 1
2 Views