Hey there Pinot Community, We're in the process o...
# troubleshooting
c
Hey there Pinot Community, We're in the process of setting up our Pinot cluster and are looking for some guidance and best practices on monitoring and health checks. Specifically: 1. Recommended Tools and Integrations: What are the best tools and integrations for monitoring Pinot clusters? Are there any specific tools you would recommend for metrics, logging, and alerting? 2. Health Check Endpoints: What health check endpoints should we be monitoring? Are there any critical endpoints that we should pay special attention to? (I've already read the deployment and monitoring page) 3. Best Practices: Are there any established best practices for setting up monitoring for Pinot clusters? Any tips on configuring alerts and thresholds to ensure optimal cluster performance? 4. Common Pitfalls: What are some common pitfalls to avoid when setting up monitoring for a Pinot cluster? Any insights, resources, or examples from your experiences would be greatly appreciated. Thanks in advance for your help!
x
1. Use Prometheus and grafana, see: https://docs.pinot.apache.org/operators/tutorials/monitor-pinot-using-prometheus-and-grafana 2. There are multiple health check apis for k8s, liveness, readiness and startupProbe. See helm or read the healthcheck API implementation. 3. See example in the docs shared in 1 4. Monitor and alert on Prometheus disk usage