Slackbot
12/27/2022, 9:35 AMIgor Berman
12/27/2022, 9:36 AMWhen the segment lock is used, a task locks individual segments instead of the entire time chunk. As a result, two or more tasks can create segments for the same time chunk of the same data source simultaneously if they are reading different segments. For example, a Kafka indexing task and a compaction task can always write segments into the same time chunk of the same data source simultaneously. The reason for this is because a Kafka indexing task always appends new segments, while a compaction task always overwrites existing segments. The segments created with the segment locking have the same major version and a higher minor version.
The segment locking is still experimental. It could have unknown bugs which potentially lead to incorrect query results.
https://druid.apache.org/docs/latest/ingestion/tasks.html#lockingBen Krug
12/27/2022, 8:42 PM