Shubham Kumar
07/30/2025, 11:49 AMis_deleted (configured as deleteRecordColumn) as true for soft deletion of 5K rows.
However, after the deleteRecordTTL period, the primary keys are not being deleted. I can see that the documents are unqueryable, but they are still present in the primary key map.
Is there a scheduler that handles this cleanup?
Does it run automatically, or do we need to trigger it manually?
Can we configure the frequency at which it runs?Mayank
Shubham Kumar
07/30/2025, 7:01 PMSan Kumar
07/31/2025, 12:56 AMShubham Kumar
07/31/2025, 5:09 AMShubham Kumar
07/31/2025, 7:36 AMcontroller.realtime.segment.validation.frequencyPeriod=2m to the controller config. Now, the periodic task RealtimeSegmentValidationManager runs in 2 minutes and is responsible for removing the deleted primary keys from the metadata.San Kumar
07/31/2025, 10:56 AMMayank
Shubham Kumar
07/31/2025, 4:41 PM