Hi Folks, We are exploring upsert feature in Pinot. Have few questions around this. Please help me to understand the feature. 1. We are using managed offline flow with 2 days as the buffer time which means they get converted to OFFLINE segments after 2 days. However our REALTIME segments rollup at every 1 hour/partition.  Does the upsert can handle any update within this 2 days time period? 2. How is this handled in managed offline flow. Does these multiple update records for same row gets merged to single row? 3. I'm going through the related design documents available here. But for one document access is closed. Can you please provide access.

Thanks @User for the response. Can you please clarify this? What happens to these records during OFFLINE conversion. Say, we got 3 records for a row (1 original and 2 partial updates). All 3 won't get merged into single record during OFFLINE conversion? If no, then which record stays.

hey, due to company policy, that doc cannot have anonymous access. if you want to read, plz request the gdoc access

Hey, @User what I meant was that if you have a record that was already moved to offline, then if an upsert comes in for it in realtime, then it will not be considered as an upsert, but new row for RT table.

I'm clear of that case. Once the record is moved to OFFLINE there will be no update. But I'm trying to understand what happens to the updates that came before OFFLINE conversion.

short answer is OFFLINE table is not supported in upsert