Yes, you can move tables/streams to a new connection pointing to the same destination without rebuilding or re-syncing historical data by copying the connection state for incremental streams [
Forum Post: Questions on Switching Connectors and Syncing YAML in Airbyte Cloud;
Forum Post: Using State from Existing Connection for New Connection in API Extraction].
Here is how you can do this:
1. Ensure the destination configuration matches When creating the new connection, make sure the destination settings (such as Destination Namespace, Stream Prefix, sync modes, and table structure) match the original connection so that data is written to the exact same destination tables [
Forum Post: Questions on Switching Connectors and Syncing YAML in Airbyte Cloud].
2. Copy the Connection State from the original connection 1. In the Airbyte UI, open your
existing connection [
Documentation Platform > Cloud > Managing-airbyte-cloud>].
2. Go to the
Settings tab and expand the
Advanced section [
Documentation Release_notes > Self-managed > Upgrading to Destinations V2 > Advanced Upgrade Paths > Upgrading Connections One by One with Dual-Writing > Additional Steps for Incremental Sync Modes>].
3. In the
Connection State editor, locate and copy the JSON state object (cursor information) corresponding to the specific streams/tables you are moving [
Documentation Release_notes > Self-managed > Upgrading to Destinations V2 > Advanced Upgrade Paths > Upgrading Connections One by One with Dual-Writing > Additional Steps for Incremental Sync Modes>].
3. Apply the state to the new connection 1. Open the
new connection in the Airbyte UI.
2. Go to the
Settings tab >
Advanced >
Connection State [
Documentation Platform > Cloud > Managing-airbyte-cloud>].
3. Paste the copied stream state JSON into the state editor for the respective streams [
Documentation Release_notes > Self-managed > Upgrading to Destinations V2 > Advanced Upgrade Paths > Upgrading Connections One by One with Dual-Writing > Additional Steps for Incremental Sync Modes>].
4. Click
Update State and confirm the changes [
Documentation Platform > Cloud > Managing-airbyte-cloud>].
4. Adjust the original connection and run the sync 1. Disable or deselect the moved tables in the original connection so they are no longer synced twice.
2. Run a sync on your new connection. It will pick up from the existing cursor state and only fetch new/incremental records rather than performing a full refresh [
Documentation Platform > Cloud > Managing-airbyte-cloud>;
Documentation Release_notes > Self-managed > Upgrading to Destinations V2 > Advanced Upgrade Paths > Upgrading Connections One by One with Dual-Writing > Additional Steps for Incremental Sync Modes>].
>
Caution: Updates to connection state should be handled with extreme care, as invalid state entries can cause sync failures [
Documentation Platform > Cloud > Managing-airbyte-cloud>]. 👍 0 button 👎 0 button ℹ️
Tip: Mention
@kapa.ai in the thread for follow-ups or
DM the app for
1-to-1 help., with interactive elements