This message was deleted.
# troubleshooting
s
This message was deleted.
i
How many task slots do you have? Auto compaction I believe will only use 10% of available slots. Do you see any compaction tasks running? It looks like it is working but may take some time as free slots become available. It will always show running when auto compaction is working until fully compacted.
👍 1
t
Also , If auto-compaction is configured, you should see in coordinator messages like
Copy code
2023-06-14T09:49:42,917 INFO [Coordinator-Exec--0] org.apache.druid.server.coordinator.duty.CompactSegments - Compact segments
2023-06-14T09:49:42,943 INFO [Coordinator-Exec--0] org.apache.druid.server.coordinator.duty.NewestSegmentFirstIterator - All segments look good! Nothing to compact
a
@Ian Roberts Thanks for replying ,
Copy code
{
  "latestStatus": [
    {
      "dataSource": "eberspacher_gateway_sensor",
      "scheduleStatus": "RUNNING",
      "bytesAwaitingCompaction": 10027661,
      "bytesCompacted": 0,
      "bytesSkipped": 2474156,
      "segmentCountAwaitingCompaction": 886,
      "segmentCountCompacted": 0,
      "segmentCountSkipped": 28,
      "intervalCountAwaitingCompaction": 3,
      "intervalCountCompacted": 0,
      "intervalCountSkipped": 2
    },
    {
      "dataSource": "eber_vehicles_gps",
      "scheduleStatus": "RUNNING",
      "bytesAwaitingCompaction": 5147597,
      "bytesCompacted": 8443976,
      "bytesSkipped": 437512,
      "segmentCountAwaitingCompaction": 557,
      "segmentCountCompacted": 23,
      "segmentCountSkipped": 3,
      "intervalCountAwaitingCompaction": 33,
      "intervalCountCompacted": 23,
      "intervalCountSkipped": 1
    },
    {
      "dataSource": "eber_vehicle_components_status",
      "scheduleStatus": "RUNNING",
      "bytesAwaitingCompaction": 3469208,
      "bytesCompacted": 0,
      "bytesSkipped": 776359,
      "segmentCountAwaitingCompaction": 1189,
      "segmentCountCompacted": 0,
      "segmentCountSkipped": 3,
      "intervalCountAwaitingCompaction": 854,
      "intervalCountCompacted": 0,
      "intervalCountSkipped": 3
    },
    {
      "dataSource": "eber_gateways_sensors_data",
      "scheduleStatus": "RUNNING",
      "bytesAwaitingCompaction": 10877996,
      "bytesCompacted": 20308787,
      "bytesSkipped": 996307,
      "segmentCountAwaitingCompaction": 1714,
      "segmentCountCompacted": 297,
      "segmentCountSkipped": 26,
      "intervalCountAwaitingCompaction": 813,
      "intervalCountCompacted": 295,
      "intervalCountSkipped": 2
    }
  ]
}
And its stuck on Running for more then a week now !!
@Tejas Parbat I don’t see any logs from coordinator
h
Auto-compaction (if the configuration at cluster is unchanged) runs every 30mins, default settings. In every sweep it checks for the eligible segments for auto-compaction and picks them up for compaction depending on the compaction configuration. So, auto-compaction must be getting triggered every 30mins. Also check if you see any errors in the Coordinator and the Historical services.