Hi ,
I was going through <https://docs.pinot.apach...
# generale
Eaugene Thomas
07/19/2022, 6:05 AMHi ,
I was going through https://docs.pinot.apache.org/operators/operating-pinot/tuning/routing#partitioning & had this doubt . From my understanding pinot segments are partitioned timestamp based . But the above doc mentions the segments can be partitioned based on a particular dimensions . Not clear with this part of timestamp based partitioning between segments & dimension based partitioning between segments . Can any one explain more clearly on that ? Thanks in Advance !
k
Kishore G
07/19/2022, 6:06 AM
you can partition segments by both space (dimension) and time
e
Eaugene Thomas
07/19/2022, 6:10 AMSo , by default pinot partitions based on timestamp unless dimension to partition is specified in config . Is that correct ?
Eaugene Thomas
07/19/2022, 6:14 AMIf thats the case , I have a follow-up doubt, The job to move the data from realtime server to offline server works based on segments start & end time ( ref : https://dev.startree.ai/docs/pinot/concepts/managed-offline-flow ) . So how thats possible in the case of partitioning based on dimension & not time stamp ?
k
Kishore G
07/19/2022, 3:26 PM
it can do both right
Kishore G
07/19/2022, 3:27 PM
first break up segments for a day
Kishore G
07/19/2022, 3:27 PM
and within each day, partition by a dimension
e
Eaugene Thomas
07/20/2022, 4:51 AMGot it . Thanks @Kishore G