BentoML

Hi Max, sorry there isn’t one, are you familiar with Grafana and Prometheus?

yes, I just haven't looked into how bento does things exactly

can you point me to the code for your integration?

I see, If you start a BentoML server, simply go to the `/metrics`  endpoint

most of the common metrics you would need for a model server is already instrumented there

User can also import prometheus python client and add additional metrics in their BentoService python code, those will also be displayed on the `/metrics`  endpoint