Is pinot able to do PERCENTILEs and PERCENTILE agg...
# getting-startedt
Tiger Zhao
09/08/2021, 10:17 PMIs pinot able to do PERCENTILEs and PERCENTILE aggregates in the star tree on columns with NULL values?
j
Jackie
09/09/2021, 1:06 AMCurrently star-tree does not work with null value index, but it should be possible to skip the null values when creating the pre-aggregation records for star-tree.
Jackie
09/09/2021, 1:07 AMCan you please create an issue for this? We should skip the NULL values when creating the star-tree
👍 1
t
Tiger Zhao
09/09/2021, 2:20 PM@User specifically, do you mean that the NULL values are currently not supported for both the dimension and metric columns when generating the star tree?
We have a use case where we have a metric column that occasionally has NaN/NULL values. But we want to compute pre-aggregate PERCENTILE_EST for that column (specified in functionColumnPairs in the star tree config) and have it skip over the null values.
Thanks!
Tiger Zhao
09/09/2021, 2:34 PMAlso, if a dimension column has NULL values and I try to generate the star tree with it in dimensionsSplitOrder, what ends up happening?