Hi team, I am using below configs, i have 36 partitions and every 1-1.5hr consuming segments are flushed so around 800 new segments. Now initial partitions segments are properly merged and but later partitions are not picked by UpsertCompactMergeTask task. What changes should i do so that every partitions are picked?

"task": {
      "taskTypeConfigsMap": {
        "UpsertCompactionTask": {
          "schedule": "0 */5 * ? * *",
          "bufferTimePeriod": "1h",
          "invalidRecordsThresholdCount": "1",
          "tableMaxNumTasks": "40",
          "validDocIdsType": "SNAPSHOT"
        },
        "UpsertCompactMergeTask": {
          "schedule": "0 0 */1 ? * *",
          "bufferTimePeriod": "1m",
          "maxNumSegmentsPerTask": "100",
          "maxNumRecordsPerSegment": "50000000"
        }
      }
    }