@kapa.ai does bigquery supports cdc?

Yes, BigQuery does support Change Data Capture (CDC) with Airbyte. However, there are some considerations and potential issues you might encounter during the setup and operation. ### Key Points to Consider: 1. Connector Versions: - Ensure you are using the latest versions of Airbyte and the BigQuery connector. This can help avoid known issues and benefit from the latest fixes and improvements. ([Source](https://discuss.airbyte.io/t/2839)) 2. Configuration: - When setting up CDC, make sure to follow the specific configuration steps for your source database. For example, if you are using MySQL, the cursor is chosen automatically by the CDC system. ([Source](https://discuss.airbyte.io/t/2127)) 3. Common Issues: - Normalization Errors: You might encounter normalization errors during the dbt run, which could indicate problems with the data itself or type mismatches. It is recommended to test the sync without CDC to isolate the issue. ([Source](https://discuss.airbyte.io/t/2839)) - Replication Failures: If you encounter replication errors, it might be due to issues with the CDC setup or data inconsistencies. ([Source](https://discuss.airbyte.io/t/4397)) 4. Schema and Table Creation: - Airbyte creates additional schemas and tables (e.g., raw, scd, and normalized tables) during the sync process. Ensure that your BigQuery setup allows for these operations. ([Source](https://discuss.airbyte.io/t/2839)) ### Example of Viewing Normalized Tables: To view the history table in BigQuery, you can execute a query like the following:

sql SELECT * FROM cdc_tut_scd;

([Source](https://airbyte.com/tutorials/incremental-change-data-capture-cdc-replication)) ### Additional Resources: - [Incremental Data Synchronization Tutorial](https://airbyte.com/tutorials/incremental-data-synchronization) - [CDC Setup for MSSQL](https://docs.airbyte.com/integrations/sources/mssql#change-data-capture-cdc) By following these guidelines and ensuring your setup is correct, you can effectively use CDC with BigQuery in Airbyte. If you encounter specific issues, reviewing the logs and configuration settings can help diagnose and resolve them.