Hi, is there any way to not use CDC for the mongod...
# ask-community-for-troubleshooting
f
Hi, is there any way to not use CDC for the mongodb connector?
k
Yes, the MongoDB connector supports syncing without CDC. According to the [MongoDB V2 documentation](https://docs.airbyte.com/integrations/sources/mongodb-v2#replication-methods), the connector offers two replication methods: 1. CDC (Change Data Capture) - Uses MongoDB's change streams for incremental syncs 2. Full Refresh - Allows reading the entire contents of a collection repeatedly The [Full Refresh mode was added in version 1.3.0](https://docs.airbyte.com/integrations/sources/mongodb-v2#changelog) (March 2024). As stated in the documentation: > The Full refresh sync mode added in v4.0.0 allows for reading a the entire contents of a collection, repeatedly. The MongoDB source connector is using checkpointing in Full Refresh read so a sync job that failed for network error for example, Rather than starting over it will continue its full refresh read from a last known point. So you can configure your MongoDB connection to use Full Refresh sync mode instead of CDC if you prefer not to use change data capture.
f
@kapa.ai when should deduplication not used?
k
A message from kapa.ai
Based on the knowledge sources, deduplication should not be used in the following scenarios: 1. When you don't have a primary key: According to the [incremental data synchronization tutorial](https://airbyte.com/tutorials/incremental-data-synchronization#step-2), "because [Incremental Sync - Append](https://docs.airbyte.com/understanding-airbyte/connections/incremental-append) sync mode does not do any deduplication, it does not require a primary key to be defined." Conversely, deduplication modes require a primary key to identify unique records. 2. When you want to preserve all historical versions of records: The [Incremental Sync - Append + Deduped documentation](https://docs.airbyte.com/platform/using-airbyte/core-concepts/sync-modes/incremental-append-deduped) explains that in deduped mode, "data in the final table will be unique per primary key" and keeps "only the latest de-duplicated data row." If you need to maintain multiple versions of the same record over time, you should use Incremental Append mode instead, which "would just add a new row with the updated data" rather than combining rows. 3. When you need to track all intermediate states: As mentioned in the [tutorial](https://airbyte.com/tutorials/incremental-data-synchronization#step-3), "If a record is modified multiple times between synchronization iterations, only the state of the record at the time of synchronization will be replicated to the destination. Other intermediate states will not be recorded." If tracking all intermediate changes is important, deduplication may not be appropriate. In these cases, you would typically use Incremental Sync - Append mode instead, which preserves all versions of records without deduplication.