Airbyte is an open-source data integration engine that helps you consolidate your data in your data warehouses, lakes and databases.

Airbyte

What is the ETA for sql server deletes/soft deletes/log based replication?

We're on hold in production deployment until we can get this part implemented. Thx

<@U01AS8LGX41> what’s the current estimate?

We are working on this this month. Our goal is to have a deliverable by then, but we are still planning out how we are going to do it, so i don't have anything more firm than that..

It's one of our top 2 highest priority core features, so we're going to keep hammering on it until we get it done.

Thanks for the update! Looking forward to this feature. We have some pipelines in production. This would give us the ability to add 6 additional sources into production and migrate fully from Qlik Replicate.

Checking back in on this. Any update on Log based replication for SQL Server?

I know it's on the roadmap. <@U01A6TEQXRU> may be able to give more details on ETA.

feel free to follow this issue <https://github.com/airbytehq/airbyte/issues/2848> for updates — I’ll update this thread as well once it’s launched

Hi <@U01A6TEQXRU>. Does this issue cover CDC based replication from SQL Server or does it use the transaction log? If it’s CDC will it also cover DDL changes as well as DML?

<@U026030NMUH> can you speak to this part?

Hey <@U026J44H6E9>, we _are_ using <https://docs.microsoft.com/en-us/sql/relational-databases/track-changes/about-change-data-capture-sql-server?view=sql-server-ver15|SQL Server's CDC> implementation, however we're only covering DML, for now. When we introduce handling schema evolution (I'm not sure on timelines for that <@U01A6TEQXRU>?) it would make sense imo to implement DDL where possible in CDC implementations.

In terms of timeline for DML SQL Server CDC, it should be available within the next week or two :+1:

update: SQL Server CDC is now live on MSSQL source connector version 0.3.3 (see <https://docs.airbyte.io/integrations/sources/mssql|docs for setup instructions>)

completely missed this in the announcements. Thanks!!