https://pinot.apache.org/ logo
m

Matt

04/09/2021, 4:45 AM
Hello , What will happen to the in realtime in-memory consuming segment if a server is restarted? Do Pino start recreating the segment again after restart or I lose the data?
m

Mayank

04/09/2021, 4:45 AM
Server will restart consuming from previous checkpoint, no data loss.
m

Matt

04/09/2021, 4:51 AM
I am actually thinking from the point of sudden and unexpected restarts or crashes. Not a proper restart.
Also wondering How Pino knows where to resume from in case of in-memory segments.
m

Mayank

04/09/2021, 4:52 AM
Yes, still the same behavior. Kafka offsets are checkpointed with segments that are flushed. Any recovery restarts from that point.
Checkpoints are saved
m

Matt

04/09/2021, 4:54 AM
Thanks Mayank, it is good to know that the checkpoints are saved and Pino can survive crashes.
m

Mayank

04/09/2021, 4:55 AM
👍