Hi Team, Is it possible to recover deleted realtime segments back into REALTIME table? Context: We had a REALTIME table DRIVER_METRIC, we accidentally deleted the table from pinot console which used 7d default retention of segments. So we can still see the deleted segments in S3 but table is not available for query anymore. Now, we have created DRIVER_METRIC REALTIME table again which is available for query and consuming data from Kafka but it only has last 1day of data (kafka topic retention). Now, we want to push old data into this table from deleted segments folder in S3. Is it possible? If possible how? cc: @Lee Wei Hern Jason

Backfilling is one option

This backfilling is done on OFFLINE table. We were thinking if we could bring back the deleted segments in the deep store into the real-time table. I believe is possible since they purposefully kept the deleted segments.

Yes it is possible, there is no out of box process to get this done yet. You can write a script that converts the back up segments to deep store segments.

yep it works. Thanks alot guru for assisting on this, we are able to recover the data. 🙏