Hi All, Ive faceing one issue in my 3 node cluster. Like table is stable on run like 1hr retention, but after new table added in cluster for 24hr retention, 2nodes in cluster not deleting segments for both tables. Ive checked controller logs only 1st node deleting its segmests but other 2 nodes controllers not even start retention manager. Did anyone face kind of issue, so please let me know. Thankyou in advance :)

How are you identifying it is not running? The source of truth is External View, and not the disk location

this is how table look like. Some segments are in bad status although it needs to be deleted.

Yeah, so first you can check the debug api or pinot server log on why those segments are in bad state.