How Pinot loads the segment.i.e. If I am consuming...
# general
r
How Pinot loads the segment.i.e. If I am consuming data from Kafka and if any new events come in Kafka so pinot will load the entire segment once again or only the new events.?
m
For new events are consumed in memory. For segments already flushed to disk, Pinot memory maps them so only part of the segment needed to be read is pulled in.
r
Okay @User Thank ! !.Do we hv any documents for the same to understand how internally it works and how internally controller store it on server.?
Also, there are intro to Pinot videos in the docs page
r
Thanks @User