This message was deleted.
# ask-for-helps
Slackbot
04/27/2023, 5:54 PMThis message was deleted.
c
Chaoyu
04/27/2023, 9:07 PMHi @Michael Aydinbas , to clarify, are you using yatai for deploying BentoML on k8s?
m
Michael Aydinbas
04/28/2023, 7:46 AMnope our own company on-prem kubernetes cluster
Michael Aydinbas
04/28/2023, 7:47 AMfor a service to be reachable from outside I have to create an ingress and all our rest services start with
/rest/<service>//metrics/rest/<service>/metricsMichael Aydinbas
04/28/2023, 9:10 AMmy assumption might be wrong here and it actually can keep /metrics because it is scraped internally and not from outside
👍 1
c
Chaoyu
04/28/2023, 10:03 AMGot it, if you use the cluster internal url for accessing the service, it should be ok
Chaoyu
04/28/2023, 10:04 AMAlso if you are running multiple replicas
Chaoyu
04/28/2023, 10:04 AMThis could become more tricky
Chaoyu
04/28/2023, 10:04 AMBtw Yatai is an open source cloud native tool that you can install on any k8s cluster with helm install
Chaoyu
04/28/2023, 10:05 AMIn many AI use cases, it helps scaling BentoML workloads better than plain container deployments
m
Michael Aydinbas
04/28/2023, 11:50 AMthanks for the help!