Is there a way to configure pinot to delete segmen...
# troubleshooting
n
Is there a way to configure pinot to delete segments from deepstore after a certain amount of time but only if it's not referenced in the actual table anymore? Ex: "Delete from deepstore every segment file that is more than 1 week old and no longer referenced in the table" We don't want to set retention period on segments as our data doesn't expire, but our deepstore is constantly growing in size as segments are replaced but not deleted from deepstore Wondering if deepstore has to be cleaned up separately
m
If a segment is no longer part of the table (deleted from it either explicitly or via retention), deepstore should automatically be cleaned.
You don't need to do anything additional for deepstore cleaning.