Hi folks, I am investigating if Pinot can be used as a realtime monitoring system. We have a federated Prometheus setup right now for tracking various metrics produced by our services. However, Prometheus has some serious drawbacks at scale, namely: • high cardinality kills performance • aggregation is slower the finer the resolution • overall performance issues when going over 500M timeseries I am exploring Pinot as a potential replacement for some parts of this system. The idea is to produce high cardinality metrics but have them ingested and queried from Pinot. It looks doable but I am looking for validation from the community. Also, can Pinot understand PromQL? I saw something about support being added but not sure what's the status.

Yes, this would be a great use case. cc @Raghvendra Yadav

PromQL is only available in StarTree Pinot

Is that commercial or open source?

StarTree Pinot is commercial