Hi team, I encountered a situation where I configured UPSERT in REALTIME table, configured RealtimeToOfflineSegmentsTask at the same time, and turned on “mergeType”: “dedup” in RealtimeToOfflineSegmentsTask. Prompt when creating a table: RealtimeToOfflineTask doesn’t support UPSERT table. Check the documentation and find that UPSERT can only be applied to OFFLINE tables. Is there any way to enable UPSERT and deduplication in OFFLINE? Also, it seems that HYBRID tables can be used to deduplicate (turn on UPSERT and RealtimeToOfflineSegmentsTask), can it be done now? I don’t see how to create a HYBRID table?

From other conversations upsert only works on REALTIME tables, not in conjunction with offline tables, and is incompatible with realtime to offline process. From my understanding this is because all the tracking data for upsert is not written to the offline tables at this time so they do not have the info required for upsert processing.