Hey everyone! In case you missed last week’s amazing community call with @Ben Pankow & @Shawn Wang, no worries, we’ve gotcha covered! Check out the edited, fast-paced version on YouTube . Thanks to everyone who joined us, it was a blast! Enjoy!

For all of you who celebrated over the weekend, wishing you and your family/ friends an amazing year of the Rabbit! 🐰❤️

Hey everyone! <!channel> 😮ctavia-hello: We just launched our free connector program, making all alpha and beta connectors free on Airbyte Cloud! Starting today, all your connections with either an alpha/beta source or alpha/beta destination will be free to use on Airbyte Cloud. This involves 100+ connectors today and this number will grow to ~200 while we port 75% of open-source connectors to Cloud in the next few months. What do you need to participate in the program? Just your credit card to enroll, and those connectors will be free to use for you. When do we start charging for those connectors? We will notify you in advance when you have connections with both source and destination that will become GA, and will give you a grace period before charging you. Why do we do this? I explain it all in this article, but in summary, in order to have 1,000+ GA connectors, we need a flywheel between our growing community, great tooling and also usage of long-tail connectors to help identify edge cases / issues. We’re also mindful of the economical context :). We are on ProductHunt today and would love your support!

we are on the HN front page!!! we really appreciate your support and comments! https://news.ycombinator.com/news

This week, I have a few amazing people in mind that I wanted to recognize 😮ctavia-loves: :airbyte-heart: for the most helpful contributors: @Akilesh V, @Andres Gutierrez and @Geoff Genz :airbyte-fire: for the contributors that sparked the most discussion: @Jon Simpson, @Chen Lin and @Joey Taleño So thank you!!

Hey everyone! 😮ctavia-hello: We had two big announcements that came out in January! 😮ctavia-partying: Airbyte Connector Builder UI 😮ctavia-partying: We're proud to introduce the Airbyte Connector Builder UI, a visual interface for building and managing data connectors with ease. Based on our low-code CDK, the Connector Builder UI makes it easy to create connectors for a wide range of data sources with real-time feedback. 💸 Free Connector Program 💸 We also launched our Free Connector program, giving users of our Cloud platform free access to our alpha and beta connectors. The more feedback we get, the more reliable these connectors become. And the best way to achieve that was to make these connectors free! All we ask if that you provide feedback and notify us of bugs so that together, we can maintain the best and most reliable connectors on the market! :lotus: New connectors & upgrades :lotus: • Sources: ◦ Commcare to Alpha ◦ Airtable to Beta ◦ Shopify to Alpha and on Cloud ◦ Google Analytics v4 to Beta ◦ Typeform to Beta ◦ Instatus to Alpha on Cloud ◦ Dremio to Alpha on Cloud ◦ Looker to Alpha on Cloud • New Destination: Weaviate

This week, I have a few amazing people in mind that I wanted to recognize 😮ctavia-loves: :airbyte-heart: for the most helpful contributors: @Matt Palmer, @Akilesh V and @Ajay Kulkarni :airbyte-fire: for the contributors that sparked the most discussion: @Sharath Chandra, @Lior Chen and @Andrzej Lewandowski So thank you!!

Hello everyone! I’m Jerri Comeau, the manager of the Community Assistance Team, and I’m here to tell you about some big changes coming to our current Github repository structure and processes. Executive summary: 1. The current repo, airbytehq/airbyte, is being separated into two repos to simplify the deployment process both internally and externally. 2. Connectors will continue to live in airbytehq/airbyte and

docker-compose up

will still work from this directory. 3. Platform code is being consolidated in the new airbytehq/airbyte-platform repo and users will need to switch to this repo to actually start and run Airbyte. Detailed Information: In order for our Engineering, Product, and Design teams to more quickly and efficiently deploy new code, we decided that the best thing to do was to split up our repositories into two already-existing pieces: the connector functionality and the platform/deployment functionality. This will allow us to make isolated changes discreetly and improve the development workflow. We’ll be making this change on 20 February but we’re letting you know now so you can prepare your workflows ahead of the change. We have done our best to limit the impact of this change, and we want everyone to know ahead of time what we’re doing. We’ll also be reminding you again before the rollout happens on 20 February.. We’ll also be updating our documentation and walkthroughs to make sure they reflect the change. Any questions? Please don’t hesitate to let us know.

This week, I have a few amazing people in mind that I wanted to recognize 😮ctavia-loves: :airbyte-heart: for the most helpful contributors: @Efim Matytsin, @Adam Bloom and @Akilesh V :airbyte-fire: for the contributors that sparked the most discussion: @Sharath Chandra, @Kacper Adler and @Sam Stoelinga So thank you!!

Hi all 😮ctavia-wave: ! We here at Airbyte are considering a Data Masking feature that would enable users to transform (hash, encrypt, etc) a selection of data during processing. There are many options and use cases that we’d love to hear about from anyone who is interested in this feature. Your input will inform how we think about this area and will be greatly appreciated. If you’re interested, please fill out this survey. We’re looking forward to hearing your thoughts, and thank you in advance!

This week, I have a few amazing people in mind that I wanted to recognize 😮ctavia-loves: :airbyte-heart: for the most helpful contributors: @Zak Keener, @Dvir Ginzburg and @Jhonatas Kleinkauff :airbyte-fire: for the contributors that sparked the most discussion: @DR, @Mark Nuttall-Smith and @Asadbek Muminov So thank you!!

A quick announcement about Kustomize versus Helm and why we’ve sunsetted Kustomize as part of Airbyte: In the process of planning our development cycle, we realized that we couldn’t support both helm and kustomize at the same time and provide the quality of experience that we wanted to for our users. We chose Helm over Kustomize because most of our users use it and it has much more community mindshare. We had planned to give a longer sunset period for Kustomize, but at the same time we were planning and executing our platform code migration, and we realized that to move kustomize as part of this migration was going to be a big lift for something we were going to sunset no matter what. So we settled for this middle ground where we sunset it with very little warning but made it possible for existing users to keep using it. This particular decision was driven by a confluence of events that we don’t anticipate happening again, and we will endeavour to give more warning and a longer sunset process in the future. Thank you for your time and attention.

Hey everyone! 😮ctavia-wave: Short month but we still have some updates for ya! New Connector and Upgrades! • New Sources: Railz • New Destinations: Exasol • Connector upgrade: ◦ Airtable to Beta ◦ Sendgrid to GA 😮ctavia-muscle: Airbyte Cloud now has 200 connectors, including 150 that are free under the Free Connector Program! 😮ctavia-muscle: This month, we’ve added 57 connectors from OSS to Airbyte Cloud and they are now available to use! The team has been hard at work making this happen so shoutout to all of them! Check out the list of connectors that went into Airbyte Cloud this month in the thread 😮ctavia-rocket: There will be more connectors available on Cloud soon, so keep your eyes peeled for more updates 👀

Hey y’all! Happy Friday from the Community Assistance Team. As part of our efforts to improve responsiveness and followup, we’re currently in the process of testing not one but TWO ai assistants to help answer quick questions that have documented resources to share. We have created two private channels so that interested community members can help with our Beta Testing. If you’d like to be part of this, and put our assistants through their paces to see which is best, then please DM me with a note that you’d like to be part of testing. We’ll be kicking this off on Monday, March 6th at 8AM Pacific time, so any time before then just let me know and I’ll get you added in. If you didn’t see this before and it’s after Monday, March 6th at 8AM, but you still want to be part of the Beta, please DM me and I’ll add you to the channels! This Beta test will run until March 23rd, so please, put these tools through their paces. We appreciate your time, attention, and assistance while we work to make our community better.

Hello everyone, and happy Friday! I’m @Jerri Comeau (Airbyte) from the Community Assistance team, and I’m asking for a little bit of time from you, the community members, on how to improve the experience of getting help (and helping others) here. We’ve created a small survey for folks around some of the planned changes to how the Community Assistance Team can be more effective. We’d like to get your thoughts on it, so we created a 5-question survey: https://forms.gle/p4qHEvUrt71HcDc78 We’ll be closing the survey on Tuesday so get your feedback in ASAP! If you feel inclined to fill out the survey, we’re also doing a raffle for some Airbyte merch as a thank you for your time and attention.

This week, I have a few amazing people in mind that I wanted to recognize 😮ctavia-loves: :airbyte-heart: for the most helpful contributors: @DHANANJAY NAIKWADI :airbyte-fire: for the contributors that sparked the most discussion: @Siddarth Jain So thank you!!

📢 Announcement: Upcoming Community Call with Bainbridge 🗓️ Mark your calendars - In just 5 days, we’ll be hosting our next community call! 📌 Date & Time: Tuesday, April 4th @ 1PM PST 🎤 Guest Speaker: @Derek Yimoyines, CTO 💡 Unlock the Power of Airbyte in Multi-Tenant Environments: Derek will reveal the secrets behind Bainbridge successful implementation of Airbyte to manage 20+ customers with multiple connectors each. You’ll discover best practices, tips, and tricks for leveraging Airflow, DBT, and other related technologies in your own multi-tenant setup. If you’re looking to boost efficiency and streamline your data pipeline, this is one event you can’t afford to miss! 🔍 About Brainbridge: Bainbridge provides an integrated SaaS solution for DTC founders, combining data, analytics, and finance. Their connected modeling service and platform help eComm CEOs make better decisions and gain a comprehensive understanding of their data. 🎟️ Register now 👈🏼*:* Don’t miss out on this exciting opportunity to learn from Bainbridge experience and supercharge your Airbyte deployment! Make sure to register here for free. We look forward to seeing you there!

📷 Join our #Airbyte Community Call on going live in just 10 minutes! Derek Yimoyines, CTO at Bainbridge will share secrets to mastering multi-tenant environments, boosting efficiency & streamlining your data pipeline. Register now for free! 📷 https://app.livestorm.co/airbyte/airbyte-community-cal-17-ft-derek-yimoyines-w-brainbridge?type=detailed

Hey everyone!! 😮ctavia-hello: We had our head in the clouds this month with no shortage of shipping either. Here’s a recap of what happened in March. 😮ctavia-partying: New Connectors and Promotions 😮ctavia-partying: • New Sources: Unleash • Promotions to GA: ◦ Airtable ◦ Google Analytics 4 • Promotions to Beta: ◦ Strava ◦ Trello • Moved into Cloud ◦ Twitter ◦ Confluence ◦ Paystack ◦ GCS ◦ ZohoCRM ◦ Yandex Metrica ◦ Salesloft ◦ Xero ◦ Paystack ◦ Trustpilot ◦ LinkedIn Pages ◦ Pipedrive ⭐ We Reached 10k GitHub Stars ⭐️ This is a huge achievement for us and we can’t thank every single one of you in the community enough! We wrote a post talking about our experience as well as some advice for others trying to reach similar goals. You can read all about it here. As always, changelogs in the thread 🙂 .

and last but not least, our new Airbyte API is now available in Public beta for our Cloud users 😮ctavia-partying: 😮ctavia-partying: 😮ctavia-partying: Learn more about it in this article!

🎉 🔐 Security check when setting up OSS Airbyte With the just releases version 0.44.0, Airbyte will do a self-check whether it’s secured properly and otherwise show the user a big error. The self test checks whether the Airbyte installation is publically available and (if secured) whether it used the default username/password. If so we try to make it perfectly clear to the user, that this will potentially leak their data. 📹 See the attached screencast for how this will look like in action. 🧑‍💻 Commit change with the change 🧵 For more technical details.

👀 Request for Feedback on “Normalizing Normalization” - https://github.com/airbytehq/airbyte/issues/25194 Hello Airbyte Community! I’m @Evan Tahler, an Engineering Manager at Airbyte, and I want to share our plans with you for how we are going to revamp Normalization this year. Normalization is the process by which Airbyte transforms the raw JSON we get from sources into meaningful columns in your data warehouse destinations, applying the right data types and doing de-duplication. The changes we are working on will lead to seeing data sooner, a better table structure, and more resilient syncs when sources produce problematic data. However, this is going to be a breaking change, so we want to hear your feedback on the plan. Please check out the Github issue where we describe the “Normalizing Normalization“ plan in more detail by April 30th. At the very least, give us a 👍 or 👎, and add any comments or questions you have to the issue. Thanks for helping to make Airbyte great!

Hello and happy Friday :meow_party: Updates on community office hours schedule and format! :airbyte-heart: Next week, we're hosting office hours everyday on a rotating schedule to accommodate more timezones :airbyte-fire: Sessions from Monday to Thursday include an in-depth presentation! Check out the schedule and zoom links below: 😮ctavia-hmm: Airbyte Architecture Overview + Q&A • Monday, April 24 - 1PM Pacific (zoom link) • Tuesday, April 25 - 16:00 CEST (zoom link) 😮ctavia-rocket: Connectors Ecosystem + Q&A • Wednesday, April 26 - 1PM Pacific (zoom link) • Thursday, April 27 - 16:00 CEST (zoom link) 😮ctavia-contributor: Open Q&A • Friday, April 28 - 1PM Pacific (zoom link) Reminders will be sent in #office-hour each day before the session begins. We look forward to seeing you there!

<!channel> hey everyone! 😮ctavia-hello:😮ctavia-hello: ⭐ Today is a big day as we’re making some significant changes to how we provide support to our community of users and contributors. 1️⃣ We will split our former #airbyte-help channels into the following: • #help-connections-issues: for any questions or issues on your connections • #help-infrastructure-deployment: for any questions or issues on your deployment and infrastructure • #help-connector-development: for any questions about on the CDKs and issues while building a custom connector • #help-api-cli-orchestration: for any questions or issues about the API, CLI, any scheduling effort. • #help-contributions: for any questions about contributing to Airbyte’s codebase 2️⃣ All those channels are now powered by a bot Kapa to help you self-serve, but our intent here is that the community will have more chances to help each other. 3️⃣ Our team will focus on providing better assistance to our active users and our contributors. Instead of addressing all issues raised in Slack and Discourse, our engineers will provide #office-hour every day now, and spend a lot more time reviewing our community PRs (3-5 new ones a day!). 4️⃣ We now provide premium support to our active open-source users. This premium support includes a direct access to our team for all your issues (connections, infrastructure, upgrading, API/CLI, connector development, etc.) and some SLA on reviewing your PRs. Don’t hesitate to join #airbyte-self-managed if you have any questions on this. Learn more in this article. 👈

Hey everyone! 😮ctavia-hello: 😮ctavia-hello: In April, we had some notable changes and a big launch! Here’s what they were: :airbyte-star: Launched Airbyte API in GA :airbyte-star: The Airbyte API will allow you to programmatically interact with Airbyte Cloud Workspaces. If you wanna read more about this and how to access it, check out these resources: • Blog Post • • Documentation 😮ctavia-loves: Changes to our Support for the Community 😮ctavia-loves: Scaling our support to the community was a big focus for us last month. We've introduced some significant changes, such as replacing manual support on Slack/Discourse with daily #office-hour, so we can spend more time reviewing all your PRs (3-5 new a day)! We also introduced a new premium support for our open-source active users! Check out the details here 🤙 Founders Community Call 🤙 Lastly we have a community call with both of our founders tomorrow and you don’t want to miss it! This is happening on May 2nd, at 1PM Pacific Time. Click here to sign up --- As always, changelog details in the thread!

Hey 😮ctavia-wave:! We will be upgrading our

destination-snowflake

connector and will be removing the AzureBlobStorage as a loading option. If you are using AzureBlobStorage as your

destination-snowflake

loading option do NOT upgrade your destination-snowflake version above 0.4.63 until updating your loading method. We recommend using Internal Staging. Thanks team!

:airbyte: Community Office Hours - May 8 to May 12 This week we've set a daily discussion topic to encourage focused conversation and deep dives. Check out the schedule below for the topic most relevant to your question. If you're not sure when to attend, feel free to ask in #office-hour or attend Friday's open Q&A! 😮ctavia-thinking: Q&A - Deploying and configuring Airbyte • Monday May 8 - 1pm PDT (zoom link) • Tuesday May 9 - 16:00 CEST / 10am EDT (zoom link) 😮ctavia-rocket: Q&A - Connectors and connections • Wednesday May 10 - 1pm PDT (zoom link) • Thursday May 11 - 16:00 CEST / 10am EDT (zoom link) 😮ctavia-contributor: Open Q&A • Friday May 12 - 1pm PDT (zoom link) Reminders will be sent in #office-hour each day before the session begins. 😮ctavia-loves:

Hi everybody! 😮ctavia-hello: We just launched our no-code connector builder, on both Airbyte Open Source and Airbyte Cloud. 😮ctavia-rocket: You can now build a new connector from scratch within 10 minutes. 😮ctavia-rocket: No local development environment required. No help needed from a data engineer. Check out the

1-min preview video▾

! We will offer a demo of the connector builder on May 26th. Here’s the link to sign up! The connector builder is best suited for synchronous HTTP API connectors. We’ve published a compatibility guide which can help you identify if a specific API is a fit for the connector builder. As we support more components, we expect that the vast majority of API connector needs will be supported. Don’t hesitate to give us a shoutout on ProductHunt today!

😮ctavia-hello: Hi all, we have an exciting announcement to share! Next week's Daily Airbyte Office Hours will feature Deep Dive Sessions hosted by the one and only @[DEPRECATED] Marcos Marx 😮ctavia-muscle: During the deep-dive sessions, Marcos will explain how Airbyte works, delving into each component in every session and explaining their functions. If you’re curious or want to learn more about Airbyte, these sessions will be truly valuable to you. For the first week we’re diving into the

airbyte-bootloader

and the

airbyte-db

services. The presentation will be 20 min, and we'll dedicate the remaining 25 min to questions about the daily topic or general Q&A. Check out the schedule below 👇 Reminders and updates will be posted in #office-hour :airbyte-fire: Deep Dive Sessions: airbyte-bootloader • Monday May 22 - 1pm PDT (zoom link) • Tuesday May 23 - 16:00 CEST / 10am EDT (zoom link) :airbyte-fire: Deep Dive Sessions: airbyte-db + Airbyte Database Internals • Wednesday May 24 - 1pm PDT (zoom link) • Thursday May 25 - 16:00 CEST / 10am EDT (zoom link) :airbyte-fire: Open Q&A • Friday May 26 - 1pm PDT (zoom link) Hope to see you there! 😮ctavia-rocket:

Hey everybody! 😮ctavia-hello: In the past few months, we surveyed the data community in order to build the State of Data 2023. With 886 participants, this is the largest data engineering survey. In the past 2 years, the data ecosystem has been evolving rapidly. New tools have been emerging every month in the modern data stack. In a hype cycle, it becomes hard to distinguish the signal from the noise. The State of Data helps us understand what the community is using and feeling excited about. 😮ctavia-partying: We’re also very thankful to have it reviewed by some of the most prominent thought leaders in the industry: Daniel Beach, Benjamin Rogojan, Andreas Kretz, Marc Lamberti, Ananth Packkildurai, Ravit Jain We hope you’ll find some interesting insights! On our side, we’re honored 🙏 by the support Airbyte receives 😮ctavia-loves:😮ctavia-loves:. We’re still early in the journey as there’s much to achieve our mission to commoditize data integration! 😮ctavia-rocket: 😮ctavia-rocket: