we have use the kill task to delete the interval segment not in the retention setting.
for example: datasource A’s retention is 3day, we will submit kill task every day to delete the segment before 3days in hdfs.
in this reindex case, the interval is still used, we just want to delete the old version folder.But the kill task will delete the interval folder, it will result in the used version folder also be deleted.
for example:
in hdfs , 20221210T040000.000Z_20221210T050000.000Z interval has two version folders.
(1)
hdfs://ip:port/druid/segments/datasourceA/20221210T040000.000Z_20221210T050000.000Z/2022-12-10T03_59_30.758Z
(2)
hdfs://ip:port/druid/segments/datasourceA/20221210T040000.000Z_20221210T050000.000Z/2022-12-10T10_22_33.385Z
kill task will delete the folder:
hdfs://ip:port/druid/segments/datasourceA/20221210T040000.000Z_20221210T050000.000Z
but
hdfs://ip:port/druid/segments/datasourceA/20221210T040000.000Z_20221210T050000.000Z/2022-12-10T10_22_33.385Z
still used.