Hi Team, There was a production issue due to which...
# troubleshootinga
Abhijeet Kushe
04/29/2022, 1:09 AMHi Team, There was a production issue due to which we lost records from 04/20 to 04/26.We create a segment each day.We have a log of all the records.I wanted to know whether I can just directly stream those records to pinot.The eventTimestamp on which the Pinot RealtimeTable is configured would be between 04/26.So will the back dated entries in the pinot realtime table be captured in a current segment or will get merged into the older segment which has been closed ?
m
Mayank
04/29/2022, 2:11 AM
Is this a realtime only or hybrid table?
Mayank
04/29/2022, 2:12 AM
If real-time only, then you can push the events again, they will be stored in new segments, but that should still be fine.
a
Abhijeet Kushe
04/29/2022, 1:10 PMThanks Mayank
l
Luis Fernandez
05/10/2022, 8:17 PMwhat if it’s a hybrid table?
m
Mayank
05/10/2022, 10:49 PM
If you have an offline push job, you can use that to push the data to offline table. If you are using minion to do the realtime to offline, then your lookback window has to be configured to look at the data from old window. However, always having a large look back window could mean more data processing.
✅ 1