https://pinot.apache.org/ logo
#general
Title
# general
r

RK

05/21/2021, 10:51 AM
How Pinot loads the segment.i.e. If I am consuming data from Kafka and if any new events come in Kafka so pinot will load the entire segment once again or only the new events.?
m

Mayank

05/21/2021, 2:30 PM
For new events are consumed in memory. For segments already flushed to disk, Pinot memory maps them so only part of the segment needed to be read is pulled in.
r

RK

05/21/2021, 3:55 PM
Okay @User Thank ! !.Do we hv any documents for the same to understand how internally it works and how internally controller store it on server.?
Also, there are intro to Pinot videos in the docs page
r

RK

05/22/2021, 11:11 AM
Thanks @User