Apache Druid

Based on our experience, it is better to have full control on compaction jobs. So we schedule them ourselves with Airflow.

Looks like, we were able to complete by running through periods through api calls. .

image.png

Is it possible that your compaction was within the "skip offset from latest" (default: 1 day)

in older versions there was also an "input segment size" limit that would cause compaction to not run if you had above a certain amount of bytes per time chunk

i believe it's been removed now, but if you aren't on the latest, yours might still have it