how can i do monitoring and observability in bentoml without using the bentocloud

Please refer to our docs: Metrics: https://docs.bentoml.com/en/v1.1.11/guides/metrics.html Logging: https://docs.bentoml.com/en/v1.1.11/guides/logging.html Model monitoring: https://docs.bentoml.com/en/v1.1.11/guides/monitoring.html

bentoml by default gives several metrics and for http serving they are at /metrics endpoint, metrics are in prometheus format. Just spin a prometheus server and make it listen to /metrics endpoint. Later on you can also create grafana dashboard