• Hi Team, I have seen that in 0.4.0, pinot has implemented the initial version of theta-sketch based distinct count aggregation function, utilizing the Apache DataSketches library. Compared to Druid the latest release which has also included DataSketches extension(Theta sketch, Tuple sketch, Quantiles sketch ,HLL sketch), pinot has any plan to implement other sketchs other than Theta sketch). Thanks.

Pinot already supports HLL and TDigest based percentiles. If there's a specific case where you would find DataSketch based implementations more useful, we can definitely explore that. If so, would recommend filing an issue for that.

Thanks for quick reply!

👍

@Mayank we maybe need to pay attention to KLL sketch vs t-digest(pinot impmentation) and seeing the following comparison by datasketches, https://datasketches.apache.org/docs/Quantiles/KllSketchVsTDigest.html

Thanks for sharing @Mark.Tang. We can definitely explore adding these if needed.

appendix(https://github.com/apache/datasketches-website/blob/master/docs/pdf/DataSketches_deck.pdf): HLL @Mayank

If you could open an issue and add all this there, it would help us track this request @Mark.Tang

I will try to open an issue to discuss sketches family @Mayank

Thanks @Mark.Tang.

https://github.com/apache/incubator-pinot/issues/6420 @Mayank