Hi Experts...i am planning to use Airbyte to replicate (postgres to postgres) our ERP Database (150 GB), but selective tables only. Is Airbyte the right choice ? Also, I have installed Airbyte and did some extraction and having configured CDC and Full refresh Overwrite, basic normalization, etc. But, what I see is that any updated row at source is duplicated at the destination. Help me to understand what I misconfigured. Thank you.
Davin Chia (Airbyte)
10/27/2021, 6:23 AM
We typically recommend using dedup + history with CDC since CDC logs all changes to a row so the same primary key can appear multiple times.
10/27/2021, 8:10 AM
Thank you @Davin Chia (Airbyte) let me try that way and revert back here if stuck at something...