Yuki Kakegawa
12/02/2025, 4:05 AMkapa.ai
12/02/2025, 4:06 AM_deleted (or similar) field, you sync it and handle deletion in your modeling layer. - Example: the Convex source exposes _deleted, and Incremental Dedupe “with deletes” will automatically remove deleted documents in the destination. [[Convex source](https://docs.airbyte.com/integrations/sources/convex)] - For many REST APIs, deletes are not exposed this way, so connectors cannot infer deletions. [[Forum 372](https://discuss.airbyte.io/t/372)] 3. Periodic Refresh Sync to mirror the source - A Refresh Sync wipes the cursor so the stream is re-synced from scratch, which can be used specifically when “the source… does not sync record deletions/removals, and you wish to mirror the source stream, which would include removing deleted records.” [[Refreshing your data](https://docs.airbyte.com/platform/operator-guides/refreshes)] - For Incremental Append + Dedupe, you can choose “Refresh stream and remove records” so that only records still present in the source remain in the final table after the refresh. [[Refreshing your data](https://docs.airbyte.com/platform/operator-guides/refreshes)] 4. Full Refresh Overwrite (if you can’t use incremental + CDC) - Community guidance: if you cannot use CDC and must have the destination mirror the source, the fallback is Full Refresh | Overwrite so the table is rebuilt each run. [[Forum 372](https://discuss.airbyte.io/t/372)] ### 3. Putting it together If you want to **keep incremental refresh and have deletes reflected**, your viable patterns are: - Incremental + CDC on a CDC-capable source (best option when supported). [[CDC vs incremental](https://airbyte.com/tutorials/incremental-change-data-capture-cdc-replication)] - Incremental with a delete flag (soft deletes) and use downstream SQL/transformations (or a connector like Convex that already uses _deleted). [[Convex source](https://docs.airbyte.com/integrations/sources/convex)] - Incremental most of the time + occasional Refresh Sync (remove records) to re-align with the source and drop rows that no longer exist. [[Refreshing your data](https://docs.airbyte.com/platform/operator-guides/refreshes)] If you share your specific source and destination, I can narrow down which of these is actually available for your setup.Lucas Segers
12/02/2025, 2:55 PM