How Pinot loads the segment.i.e. If I am consuming data from Kafka and if any new events come in Kafka so pinot will load the entire segment once again or only the new events.?
m
Mayank
05/21/2021, 2:30 PM
For new events are consumed in memory. For segments already flushed to disk, Pinot memory maps them so only part of the segment needed to be read is pulled in.
r
RK
05/21/2021, 3:55 PM
Okay @User Thank ! !.Do we hv any documents for the same to understand how internally it works and how internally controller store it on server.?