Hi All, Facing issue many times that data is lost, segments are keep increasing, how pinot decides to create new segments. From console I can see all segments are in Good state. How we can identify why data is getting lost intermittently, which is very frequent now . Which logs we should look, controller , server, broker? Getting this message from controller logs : Invalid retention time: null null for table: table1_REALTIME, skip

From your other threads it seems that it could be because of rows not consumed due to the error you pasted. check that thread for reply.