Hi Druid experts, for kafka indexing task, when intermediateHandoffPeriod < taskDuration, then task hand's off segment early. During handoff, does ingestion pause until handoff is complete?
j
John Kowtko
01/29/2025, 6:24 PM
There is a separate Java thread dedicated to building segments, so that will happen while the consumer thread continues to fetch from the stream. So you should not see a pause unless there is other resource contention (e.g. throttling due to persist back pressure)