<@U04S8PLJWMT> can I add an initial value for incr...
# replication-ask-ai
k
@kapa.ai can I add an initial value for incremental replication for clickhouse source?
k
The knowledge sources do not explicitly mention a way to set an initial cursor value for the ClickHouse source connector in Airbyte. What the documentation does say about the ClickHouse source is that it supports both Full Refresh and Incremental sync modes, but it does not describe a configuration option for setting an initial cursor/start value for incremental replication. [ClickHouse Source] For context, the ability to set an initial start date for incremental syncs is a feature more commonly described in the Connector Builder (for API-based connectors), where you can configure a
start_datetime
as the initial lower bound for the cursor. [Incremental Sync] For database sources like ClickHouse, the incremental sync typically uses a cursor column you select (e.g., an
updated_at
timestamp), and the first sync will read all existing data. There is no documented built-in option to restrict the initial load to a specific starting value for the ClickHouse source connector. If you need to limit the initial data load, a workaround mentioned in the Airbyte community is to create a view in your ClickHouse database that filters the data to the desired range, and then sync that view instead of the full table. [Partial Data Fetching] 👍 0 button 👎 0 button â„šī¸ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.