Is there a way to configure pinot to delete segments from deepstore after a certain amount of time but only if it's not referenced in the actual table anymore?
Ex: "Delete from deepstore every segment file that is more than 1 week old and no longer referenced in the table"
We don't want to set retention period on segments as our data doesn't expire, but our deepstore is constantly growing in size as segments are replaced but not deleted from deepstore
Wondering if deepstore has to be cleaned up separately