Follow up question from (^): since segments are not time-partitioned, do hybrid table which need to combine star-indexes use the time-granularity to divide the star-index (ie: allowing for star-index on online to still be efficient?)
k
Kishore G
09/09/2020, 6:17 PM
while segments need not be strictly time-partitioned, Pinot does store the min-max time for each segment and uses it for pruning segments
Kishore G
09/09/2020, 6:18 PM
time column will be part of the star tree
👍 1
Kishore G
09/09/2020, 6:18 PM
so it will still be efficient
j
Joey Pereira
09/09/2020, 6:22 PM
🤔 honestly will probably collect these Qs and find a good home for them, going. Thanks for fielding all these questions!
I only just realized Pinot was not using strictly time-partitioned data :P
k
Kishore G
09/09/2020, 6:26 PM
yes, it does not enforce it. Typically offline segments end up being strictly time partitioned while realtime segments are created based on arrival time