hey everyone!! octavia wave We're super excited to announce the release of the 0.50 version for Airbyte with 3 significant features, now available on both Airbyte Open Source and Cloud: 🔥 Schema propagation 🔥 Get connections to maintain themselves by choosing to have schema changes propagate automatically (for all changes or only columns). Keep control, if you want to, by ignoring schema changes. This feature will enable you to reduce the operational load of maintaining pipelines! 🏁 Checkpointing 🏁 A sync can fail for all sorts of reasons. Airbyte’s job is to make sure your data continues to flow, even through these interruptions. Checkpointing enables you to resume where the sync left off. It means you can now sync any volume of data, given enough time and retries. 👉 Column selection 👈 You can now select which columns you want to sync for the streams of your source connector. Be in full control of the data you want to sync, whether it's for cost purposes or privacy reasons. Here's a . Don't forget to upgrade (unless you're on Airbyte Cloud, in which case you should be able to benefit from those features without doing anything), and let us know what you think! More will be coming in the next few weeks, stay tuned! octavia rocket octavia rocket octavia rocket

@Mehak Kapoor @Vijaya Kotwani @Shiraj Gagneja @Vibhor Agrawal

@John (Airbyte) do you know when the Helm chart upgrade for Airbyte 0.50 will be released? I just upgraded to the latest available version of the chart and Airbyte is still running 0.44.12

@John (Airbyte) Hi John, I was just testing the new feature (field selection) and when creating a connection from PostgreSQL to PostgreSQL with CDC logical replication I spotted that I can only choose Full Refresh sync mode. Is this a known problem or maybe I did something wrong while upgrading Airbyte (I’m using Airbyte locally with Docker). That wis misconfiguration on my end (no tables added to publication).

Hi @Oliver Meyer, thank for bringing that to our attention. We are going to correct the version of the helm chart this morning. I’ll keep you posted!

Hey folks, I tried using column selection with the open-source version and it works great! However when I tried to import the connection using Octavia CLI it errored out. I've noticed Octavia CLI isn't updated regularly on DockerHub and there is an issue to this effect as well, and I think this might be the cause of the error. Is this something that can be addressed? Thanks!

the CLI is indeed still in alpha. we will soon release a Terraform SDK (first on Cloud), and later make an official CLI. so unfortunately, this issue might not get fixed on Octavia CLI

Just to clarify @John (Airbyte), Octavia is going to be deprecated at some point in favour of terraform then an official CLI?

I can only confirm this once we've defined the exact plan. there is a scenario where we make Octavia CLI the official one. it's just that today it isn't an official one. sorry if I can't bring more clarity...

@Henrique Melo @Eduardo Kose

Helm-charts is now on 0.45.35. When 0.50 will be available?

Hi @Jove Zhong, helm-charts v0.45.35 is what you need to get Airbyte v0.50+ . The version are no longer exactly aligned after we changed the release process for helm charts.

For the checkpointing blog, since only StateB is checkpointed, shouldn't we start from Record 7 not 10 (sorry if this is not correct channel to ask)

reach out to @Evan Tahler, he knows more about that particular feature than I do!

@Jove Zhong yep, that's a mistake! Thanks for pointing that out (and thanks for reading the blog post too)!

Any news on parallelizing large data loads? Last I heard was some progress in March.