Hello, just confirming, Does the <kafka low level ...
# general
a
Hello, just confirming, Does the kafka low level consumer guarantee exactly-once or is it at-least-once?
m
The way it is being used in Pinot, at least once
k
To clarify, Kafka consumer is at least once but Pinot tracks the offset and makes sure that it’s indexed exactly once..
In other words, you don’t have to worry about seeing duplicate rows in Pinot
m
Yes, thanks for the clarification, Kishore.
j
kishore or mayank, i think this question has come up several times in the past year. can I ask either of you to get all the clarifications around this into the docs. maybe around here? This feels like a very important part of the architecture to not be clearly indicated
m
Ack