This message was deleted.

if you run them manually

Thanks @Piotr Dołowy this is something I am submitting as job:

{
  "type": "compact",
  "dataSource": "XXXXXX",
  "interval": "2022-09-11/2022-11-13",
  "tuningConfig": {
    "type": "index_parallel",
    "maxRowsPerSegment": 5000000,
    "maxRowsInMemory": 250000,
    "maxNumConcurrentSubTasks": 10
  }
}

did you try setting granularity spec?

no.. this is what i am running.. granularity is weekly

then try with granularity. For ingestion this help because druid can determine expected segments based on segmentgranularity and interval. I didnt test it for compaction

Most of my auto-compaction jobs run with multiple subtasks ... but some run with only one. That parameter only specifies the max number of subtasks, the main compaction task may determine that it doesn't need that many if the number of expected output segments is small. How many segments is the compaction job producing? If more than one segment being generated, then can you post the task log of the main compaction task so we can take a look?