Hi all, i am pushing data to offline table from s3...
# general
v
Hi all, i am pushing data to offline table from s3 bucket. i want to update old data as per the primary key same as upsert. how can i do it for offline table?
s
there’s no upsert support for offline. In order to achieve the similar functionality, you need to pre-process your data so that the data includes the most recent data for particular primary key
Copy code
The main thing to keep in mind when combining these features is that upsert functionality only applies to real-time tables.

As soon as those segments are moved to an offline table, the upsert logic is no longer applied at query time. We will need to backfill the offline segments created by the real-time to offline job to achieve upsert-like queries.
IMG_2897.jpg