Hello, I'm setting up a MySql -> BigQuery sync...
# replication-ask-ai
p
Hello, I'm setting up a MySql -> BigQuery synchronization with Airbyte, using CDC - Incremental - Append mode. I'm trying to figure out if Airbyte provides a way to skip messages without change, the same way Debezium supports it with its skip.messages.without.change feature. I saw that Airbyte provides a way to control the colum selection. But I found no ressource related to skipping messages. Any idea if such a feature is available ? Or if there is a way to tweak the configuration of the Debezium used internally by Airbyte
k
Hmm, I don't know enough to give you a confident answer yet. Based on the information provided, Airbyte does support Change Data Capture (CDC) with Incremental - Append mode for MySQL to BigQuery synchronization. However, there's no specific mention of a feature similar to Debezium's
skip.messages.without.change
. Airbyte's CDC works by reading data from the log up to the time that the sync was started, and it keeps track of the current log position between syncs. It does not treat CDC sources as infinite streaming sources. The first time the sync is run, a snapshot of the current state of the data will be taken, which is effectively a Full Refresh. Subsequent syncs will use the logs to determine which changes took place since the last sync and update those. However, the specifics of skipping messages without change are not mentioned in the provided extracts. For more detailed information, you might want to check out the [Airbyte Documentation](https://docs.airbyte.com/understanding-airbyte/cdc) or ask in the [Airbyte Community](https://discuss.airbyte.io/).