@User will upsert will be available for batch data as well?
t
Ting Chen
05/06/2020, 3:57 AM
This is Ting from Uber. Upsert is mainly designed for realtime data ingestion. Pinot already can support update in batch data by replacing existing segments. @James Shao ^^
👍 2
j
James Shao
05/06/2020, 4:04 AM
also a bit more clarification. For batch-only table (aka pinot offline table), you don’t really need upsert as you can always override existing datas.
James Shao
05/06/2020, 4:04 AM
right now the upsert support aim at realtime-table only
James Shao
05/06/2020, 4:04 AM
we don’t have support for realtime + offline hybrid table yet