https://pinot.apache.org/ logo
#general
Title
# general
j

Joey Pereira

09/09/2020, 6:15 PM
Follow up question from (^): since segments are not time-partitioned, do hybrid table which need to combine star-indexes use the time-granularity to divide the star-index (ie: allowing for star-index on online to still be efficient?)
k

Kishore G

09/09/2020, 6:17 PM
while segments need not be strictly time-partitioned, Pinot does store the min-max time for each segment and uses it for pruning segments
time column will be part of the star tree
👍 1
so it will still be efficient
j

Joey Pereira

09/09/2020, 6:22 PM
🤔 honestly will probably collect these Qs and find a good home for them, going. Thanks for fielding all these questions! I only just realized Pinot was not using strictly time-partitioned data :P
k

Kishore G

09/09/2020, 6:26 PM
yes, it does not enforce it. Typically offline segments end up being strictly time partitioned while realtime segments are created based on arrival time