Hi, team. If an `index_kafka` task pushed the seg...
# general
r
Hi, team. If an
index_kafka
task pushed the segments and commit metadata successfully, but failed on handoff. Will new tasks start from the offset that the failed task has committed? I see no metadata rollback in the code when handoff fails.
a
Failure during handoff would mean that there can be temporary unavailability of segments that were not handed off by the task. The data has still been transactionally committed and will eventually be loaded by the historicals.
So, yes, the new tasks will use the committed offset and there is no rollback
r
Thanks!