How does adding new columns and deleting columns i...
# replication-ask-ai
y
How does adding new columns and deleting columns in incremental dedup sync mode works?
k
Here's what the Airbyte documentation says about schema changes (adding/deleting columns) in incremental sync modes: Adding New Columns When using CDC-based incremental dedup, adding a new column requires a snapshot before CDC can track changes on it. The process is: 1. Airbyte will detect a "Schema changes detected" notice in the Schema section (click Refresh source schema if the new column isn't visible). 2. Review and approve the new changes, then enable the newly added column(s). 3. Navigate to the Status page, locate the stream containing the new column, click the three dots (⋮), and choose Refresh Stream to trigger a snapshot. > âš ī¸ Adding a new column to a CDC-enabled database does not automatically enable CDC tracking on it. You must manually verify that CDC is enabled on the new column. [CDC Limitations] Deleting Columns / General Schema Changes For cursor-based incremental sync (including Append + Deduped), the current behavior cannot handle source schema changes such as columns being added, renamed, or deleted. The recommended approach is to trigger a Full Refresh - Overwrite sync to correctly replicate the data with the new schema. [Incremental Append Limitations] Additional Recommendation To avoid unintentional sync issues when schema changes occur, it is recommended to enable "Approve all schema changes myself" under Detect and propagate schema changes in the Settings section. This prevents newly detected changes from being included in the sync without a proper snapshot, reducing the risk of sync failures. [CDC Limitations] 👍 0 button 👎 0 button â„šī¸ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.