Question about automatic-compaction ``` 2024-09-01...
# general
y
Question about automatic-compaction
Copy code
2024-09-01T12:28:04,670 ERROR [Coordinator-Exec-compaction-0] org.apache.druid.server.coordinator.DruidCoordinator - Caught exception, ignoring so that schedule keeps going.: {exceptionType=org.apache.druid.java.util.common.ISE, exceptionMessage=PartitionId[32768] must be in the range [0, 32767]. Try compacting the interval to reduce the segment count., class=org.apache.druid.server.coordinator.DruidCoordinator}
what does
Try compacting the interval to reduce the segment count
mean? I see related logic behind in this PR (Introducing minor compaction with segment locking)
Copy code
Regarding restrictions above, it's important to make the partitionIds of the first-generation segments consecutive to facilitate compaction. To do this, we use separate partitionId space for first-generation segments and non-first-generation segments: (0 - 32767) is for first-generation and (32768 - 65535) is for non-first-generation segments.
Every autocompaction job is stuck on awaiting on first run.
✅ 1
Reducing a segment granularity or manual compaction will solve this problem.