Hello, do pinot supports upsert for offline tables? or do it only supports that for realtime tables? for example; when late data arrived after the real-time segment is flushed, can pinot update it?
m
Mayank
01/06/2021, 3:21 PM
@Oguzhan Mangir At the moment the support is for real-time only. However, Pinot segments don’t need to be time partitioned, so late arriving data is not an issue cc: @Yupeng Fu
y
Yupeng Fu
01/06/2021, 5:25 PM
Yes, upset is for realtime only, for offline table you can do the compaction in the segment creation job.
Yupeng Fu
01/06/2021, 5:26 PM
but the offline upsert support is on the roadmap for the upcoming months