Does it support any exactly once guarantees like D...
# general
y
Does it support any exactly once guarantees like Druid ?
m
If so, it is unclear to me if exactly once implies de-duping duplicate Kafka messages (even without failures). Or does it mean avoiding duplicates when recovering from failure? If latter, Pinot has always had that. If former, Pinot does not de-dup duplicate events during ingestion, atm.
y
I mean does it process every "kafka offset id" only once ?
m
It may reprocess to recover from failure, however, the every incoming event is indexed and stored only once (your queries won't have duplicate events because of Pinot).
y
ok, thanks
m
👍