Hi Pinot team.
I want to know. What happens if only one of the Pinot servers loses the Kafka offset? More specifically, I am curious about the case of using an Upsert table without a Retention setting.
For example, let's say the Retention of Kafka Topic is 6 hours.
Pinot's Consuming segment is flushed every 2 hours.
One Pinot Server has been stopped for 7 hours.
Pinot's segments are probably as follows.
RunningServer #1 : realtimetable__0__0, realtime__0__1, realtime__0__2, realtime__0__3 (Consuming)
RunningServer #2 : realtimetable__0__0, realtime__0__1, realtime__0__2, realtime__0__3 (Consuming)
BadServer #3 : ???
What happens to the segments in this case? Will BadServer copy the segments? Or will there be data loss?