Garry Chan
07/13/2021, 2:38 PMfull refresh - overwrite
, since I need the latest and greatest, and the primary key will not be enough as a cursor field?
2. I have an order_carts table that gets updated if there's a new event, with a created_at field. Existing rows will never be changed. In this case, I think I can use incremental - append
, since it would just add the new fields since the last sync.Davin Chia (Airbyte)
Davin Chia (Airbyte)
deleted_at
column will appear in the destination table. Queries can use this column as a filter to know what is deleted. There is some complexity but the benefit is not always having to sync all the data. Not necessary if the original table is smallGarry Chan
07/13/2021, 2:51 PMDavin Chia (Airbyte)
Garry Chan
07/13/2021, 3:08 PMGarry Chan
07/13/2021, 3:18 PMDavin Chia (Airbyte)
Garry Chan
07/13/2021, 3:21 PMDavin Chia (Airbyte)