Unused segments will be deep storage but not on historical
n
Nir Bar On
03/14/2023, 7:23 AM
thanks , so is there an overhead on the cluster to keep unused sgements ..?
with regards to the segments processing / life-cycle ..
when / why I need to use the "kill" to delete un-used segments .. as long as they not on historical ?
v
Vijay Narayanan
03/14/2023, 7:25 AM
If you have thousand of unused segments then they will cause load on the metastore as these are still tracked in the metastore and also the coordinator keeps track of these segments. So if you know you will never need these segments then issuing the kill task reduces metastore and coordinator overhead