This message was deleted.
# general
s
This message was deleted.
b
Hi Sheng Wang, Below should delete the unused segments and hence the old folder. `druid.coordinator.kill.on`: When true, enables the Coordinator to submit a kill task for unused segments, which deletes them completely from metadata store and from deep storage. Only applies to the specified datasources in the dynamic configuration parameter killDataSourceWhitelist. If killDataSourceWhitelist is not set or empty, then kill tasks can be submitted for all datasources. `druid.coordinator.kill.period`: Defines the frequency in ISO 8601 format for the cleanup job to check for and delete eligible segments. Defaults to P1D. Must be greater than druid.coordinator.period.indexingPeriod. `druid.coordinator.kill.durationToRetain`: Defines the retention period in ISO 8601 format after creation that segments become eligible for deletion. `druid.coordinator.kill.maxSegments`: Defines the maximum number of segments to delete per kill task. More details in below link: https://docs.imply.io/latest/druid/operations/clean-metadata-store/#segment-records-and-segments-in-deep-storage-kill-task
s
hi,Bibek Sahoo.Thanks for your replying! Our druid version is 0.17, dose 0.17 has the params you mentioned?
I will check for the 0.17 release doc and update you
s
thanks!!
b
0.17 does not have this feature of auto kill, it got introduced in 0.22 as per above doc. Can you try running the kill task manually as per the example given in below link, the link is for 0.17: https://druid.apache.org/docs/0.17.0/tutorials/tutorial-delete-data.html#run-a-kill-task
s
we have use the kill task to delete the interval segment not in the retention setting. for example: datasource A’s retention is 3day, we will submit kill task every day to delete the segment before 3days in hdfs. in this reindex case, the interval is still used, we just want to delete the old version folder.But the kill task will delete the interval folder, it will result in the used version folder also be deleted. for example: in hdfs , 20221210T040000.000Z_20221210T050000.000Z interval has two version folders. (1) hdfs://ip:port/druid/segments/datasourceA/20221210T040000.000Z_20221210T050000.000Z/2022-12-10T03_59_30.758Z (2) hdfs://ip:port/druid/segments/datasourceA/20221210T040000.000Z_20221210T050000.000Z/2022-12-10T10_22_33.385Z kill task will delete the folder: hdfs://ip:port/druid/segments/datasourceA/20221210T040000.000Z_20221210T050000.000Z but hdfs://ip:port/druid/segments/datasourceA/20221210T040000.000Z_20221210T050000.000Z/2022-12-10T10_22_33.385Z still used.
b
Kill task should remove only the UNUSED old segments and the new ones should not be affected.
s
thanks!! we test and verify this case.