This message was deleted.
# generals
Slackbot
05/10/2023, 5:50 AMThis message was deleted.
i
Imran Imran
05/10/2023, 6:00 AMYou can specify in console compaction config, Please check the below screenshot for reference.
v
Viraj Raul
05/10/2023, 6:02 AMokay thanks, what is max split size
i
Imran Imran
05/10/2023, 6:22 AMMaxSplitSize:- this is related to the “split hint spec” used for parallel ingestion: https://druid.apache.org/docs/latest/ingestion/native-batch.html#size-based-split-hint-spec
It imposes a limit on the maximum number of bytes that can be processed by a single parallel sub task. I think the case where you may want to adjust it from the default would be if you get OOMs with the 1GB default (lower the limit).
v
Viraj Raul
05/10/2023, 6:28 AMokay
Viraj Raul
05/10/2023, 6:28 AMI am facing issue in applying compaction on a table, i have posted the issue in general channel
Viraj Raul
05/10/2023, 6:28 AMshall i post it here if you can help.?
i
Imran Imran
05/10/2023, 6:41 AMWhat are the changes you are making in the new spec?
v
Viraj Raul
05/10/2023, 6:41 AMdefining max rows per segment, earlier i only mentioned the month granularity
Viraj Raul
05/10/2023, 6:42 AMbut i need even more compact segments with 5million records in each as the size is very less
i
Imran Imran
05/10/2023, 7:02 AMI will try on my cluster and let you know
v
Viraj Raul
05/10/2023, 8:19 AMokay, thanks