https://linen.dev logo
m

Marco Sollie

05/12/2021, 8:48 AM
Hi Team, Would it be possible to try out the CDC for MySql. I understand it's not stable right now, but would love to test it.
u

user

05/12/2021, 9:36 AM
hey @Marco Sollie we dont have CDC support for MySQL at this point. Ref : https://docs.airbyte.io/understanding-airbyte/cdc We are going to start working on it very soon (probably this week or next week)
u

user

05/12/2021, 9:37 AM
Sure! We got some good folk on the team happy to give it a go or help out with that. Let me know if we can do something from our side.
u

user

05/12/2021, 10:26 AM
Hi @Marco Sollie @Subodh (Airbyte) we’d be really keen to help test CDC for MySQL, it’s stopping us moving to Airbyte, which I’d love to do
u

user

05/12/2021, 11:44 AM
@Marco Sollie @Giles Horwitch-Smith we will reach out to you if we need any help/ once we have the alpha ready for MySQL CDC. Thanks 😄
u

user

05/12/2021, 11:44 AM
Cheers, thanks @Subodh (Airbyte) good luck with it
u

user

05/12/2021, 11:48 AM
Also you can track this ticket https://github.com/airbytehq/airbyte/issues/2847 for the progress
u

user

05/12/2021, 1:10 PM
Thanks @Subodh (Airbyte) !!
u

user

05/25/2021, 6:17 AM
hey @Marco Sollie @Giles Horwitch-Smith we merged the PR for mysql cdc https://github.com/airbytehq/airbyte/pull/3505 Doc : https://docs.airbyte.io/integrations/sources/mysql
u

user

05/26/2021, 8:42 AM
Thanks @Subodh (Airbyte) great to see 🙂
u

user

05/26/2021, 8:43 AM
Is that live or do I need to build from source
u

user

05/26/2021, 3:48 PM
It was released as part of this release https://github.com/airbytehq/airbyte/releases/tag/v0.24.0-alpha the mysql docker image
0.3.1
has CDC feature
u

user

05/27/2021, 12:55 AM
awesome news!
u

user

08/24/2021, 12:43 AM
@Marco Sollie @Giles Horwitch-Smith are either of you using CDC in production and if so, what’s your largest table sizes?
u

user

08/24/2021, 6:12 AM
Hi @gunu ive not yet had a chance to try it, when I do the table sizes are likely ~3m rows
u

user

08/24/2021, 6:12 AM
Why do you ask?
u

user

08/24/2021, 8:04 AM
haven’t been successful in implementing CDC for all my tables. issues particularly with some larger tables and sometimes running into weird syncs. curious if it’s something wrong on my end