Dear community, we’ve been asked a lot about programmatic interactions with Airbyte's configurations. We are working on a CLI project called 

octavia

 octavia partying for which we wrote a tech spec summarized in this deck. Feel free to give feedback directly by commenting on the slides! We’ll start coding soon.  (cc. @Scott Pedersen @Bruno @Valentin Nourdin @Thomas CLAVET @Simbazz @Sebastien Mamessier @Nathan Atkins @Tuan Nguyen  I think you're going to be interested in this!)

Hello Airbyters (<!channel>)! We’ve been working on a very big news over the past two months: we just announced the closing of our Series-B ($150M!!!!! 😮). This new round of funding will allow us to continue to support our community, to continue to grow the Airbyte team, and to double down in Open Source and Cloud. The team and I want to say thank you to all of you for all your support and your trust over the past year. None of it would have been possible without you. Together let’s continue to power the new world of data! John and I will host a live video call on Tuesday 01/12 at 11am PT, where we will show the community how we pitched Airbyte for the Series-B and reply to any questions the community might have. Sign up on that session here! Also we launched a referral program, so if you know anyone that you believe would be a great fit for Airbyte, don’t hesitate to refer them!

This week, I have a few amazing people in mind that I wanted to recognize octavia loves airbyte heart for the most helpful contributors: @Anahita, @Octavia Smartie and @Jags (Kloud.io) 🔥 for the contributors that sparked the most discussion: @Nick Booth, @Ayyoub Maulana Hadidy and @Eugene Krall So thank you!!

Hi everyone! (<!channel>) The Airbyte team, John and I would like to wish you all a happy new year!!! With 2021 over, let’s do a bit of a retrospective: • we built an amazing community, • we went from 0 to 1 with the product, • we now support over 150 connectors, • we released the private beta of Airbyte Cloud, • we raised enough capital to build the most formidable team (careers & referral). May 2022 be a year of new opportunities, health and successes for all of you! On our side, you can count on us to continue our mission to commoditize data integration with at least the same enthusiasm and velocity that we’ve demonstrated over the past year. ❤️

Hi <!channel>! We are back with some patch notes after a restful vacation and are ready to have a productive year! octavia rocket Here's all of the changes from

0.34.1

to

0.35.3

. As a heads up, I've thrown 🐛 fixes into the thread attached to this announcement! New Source: 3PL Central (contributed by @Juozas) New Source: My Hours (contributed by @Wisse Jelgersma) New Source: Qualaroo (contributed by @gunu) New Source: SearchMetrics 💎 Salesforce Source: Now supports filtering streams at configuration, making it easier to handle large Salesforce instances. 💎 Snowflake Destination: Now supports byte-buffering for staged inserts. 💎 Redshift Destination: Now supports byte-buffering for staged inserts. ✨ Postgres Source: Now supports all Postgres 14 types. ✨ Recurly Source: Now supports incremental sync for all streams. ✨ Zendesk Support Source: Added the

Brands

,

CustomRoles

, and

Schedules

streams. ✨ Zendesk Support Source: Now uses cursor-based pagination. ✨ Kustomer Source: Setup configuration is now more straightforward. ✨ Hubspot Source: Now supports incremental sync on all streams where possible. ✨ Facebook Marketing Source: Fixed schema for

breakdowns

fields. ✨ Facebook Marketing Source: Added

asset_feed_spec

to

AdCreatives

stream. ✨ Redshift Destination: Now has an option to toggle the deletion of staging data. Thank you to our fantastic contributors from the past few weeks who have guided us into the new year 🎉 @Deividas J, @Mohamed Magdy, @Juozas, @Achmad Syarif Hidayatullah, @Christopher Wu, @Christian Persson, @jdclarke5, @Titas Skrebė, @Fran Lozano, @mariusandra, @Maciej Nędza, @jzcruiser, @Nitesh Kumar, @Valentin Nourdin, @Wisse Jelgersma, @gunu, @houssem, @Ping, and @haoranyu!

https://app.livestorm.co/airbyte/behind-the-curtain-of-airbytes-series-b?type=detailed If you were a part of the community call for the Series B "Behind the Scenes" and didn't get your question answered, here is a thread for following up on any outstanding questions for our co-founders. Thank you everyone for coming, it was great seeing everyone out here today octavia loves You can sign up at this link to rewatch the presentation and we will be posting it on our YouTube channel tomorrow.

Hey <!channel>! Let's go over the patch notes from versions

0.35.6

to

0.35.12

, New Source: Chartmogul (contributyed by @Titas Skrebė) New Source: Hellobaton (contributed by @Daniel Luftspring) New Source: Flexport (contributed by @Juozas) New Source: PersistIq (contributed by @Wadii Zaim) ✨ Postgres Source: Users can now select which schemas they wish to sync before discovery. This makes the discovery stage for large instances much more performant. ✨ Shopify Source: Now verifies permissions on the token before accessing resources. ✨ Snowflake Destination: Users now have access to an option to purge their staging data. ✨ HubSpot Source: Added some more fields for the

email_events

stream. ✨ Amazon Seller Partner Source: Added the

GET_FLAT_FILE_ALL_ORDERS_DATA_BY_LAST_UPDATE_GENERAL

report stream. (contributed by @ron-damon) ✨ HubSpot Source: Added the

form_submission

and

property_history

streams. 🐛 DynamoDB Destination: The parameter

dynamodb_table_name

is now named

dynamodb_table_name_prefix

to more accurately represent it. 🐛 Intercom Source: The handling of scroll param is now fixed when it is expired. 🐛 S3 + GCS Destinations: Now support arrays with unknown item type. 🐛 Postgres Source: Now supports handling of the Java SQL date type, improving the functionality of CDC. (contributed by @Léon Stefani) 🐛 Salesforce Source: No longer fails during schema generation. Thank you as usual to our awesome contributors that have merged PRs in the last two weeks: @Noah Kawasaki, @Gergely Lendvai, @Brian Leonard, @Mohamed Magdy, @Noam Goodman, @guidoturtu, @Tino Merl, @mmmaia, @reggermont, @Imane, @Vladimir Remar, @Léon Stefani, @ron-damon, @Wadii Zaim, @Christian Persson, @Juozas, @Prudvi Raj, @Titas Skrebė, and @koji matsumoto!

Another exciting Monday at Airbyte as we welcome 👋: • Alyssa as our Sr Product Analyst airbyte rocket • Amruta as our Staff Technical Writer, Developer Docs airbyte rocket • Javon as our People Ops Coordinator airbyte rocket • Malik as our Engineering Manager, Cloud Platform airbyte rocket • Meghan as our Sr People Ops Manager airbyte rocket • Ron as our Sr Technical Recruiter airbyte rocket

Hey everyone! Just a reminder for our next community call tomorrow at 2pm PT with Owen Kephart from Dagster. We'll showcase our new integration with Dagster 🎉 airbyte rocket !! You can sign up here! Looking forward to seeing you tomorrow!

<!channel> We're going live with our Community Call ft. Owen Kephart from Dagster now! https://app.livestorm.co/airbyte/airbyte-community-call-08-ft-owen-kephart-from-dagster?type=detailed Join to hear about the new Airbyte X Dagster integration!

Hey, <!channel>! Here are the patch notes from v0.35.31-alpha to v0.35.45-alpha 🚀 New source: Orb (contributed by @kgrover) ✨*New and improved features* • The Snowflake destination connector now has a reduced memory footprint (#10394) • The MySQL destination connector now accepts a JDBC URL input that allows users to specify additional JDBC parameters for the connection (#10362) • Improved performance and reliability and added

activities

stream for the Facebook Marketing source connector (#9805)(#10655) • Added Audience reports for the TikTok Marketing source connector (#10398) • Added a

tender_transactions

stream to the Shopify source connector (#10449) • The Salesforce source connector now supports

Replicate Incremental Deletes

(#10454) • Added the option to filter survey IDs for the SurveyMonkey source connector (#8768) • Added support for Google Meet Audit Activity Events for the Google Workspace Admin Reports source connector (#10244) • Speeded up discovery >20x by leveraging parallel API calls for the Salesforce source connector (#10516) • Improved the sync rate for the Zendesk source connector (#9456) • Implemented privileges check for the Redshift source connector (#9744) • Added

CustomerCount

stream for the Chartmogul source connector (#10756) 🐛 Bug fixes • Fixed the

coupon

stream for the Chargebee source connector (#10366) • Fixed the Python checker configs and Connector Base workflow (#10505) • Fixed field type for

tax_exemptions

for the Shopify source connector (#10419) • Fixed the connector replication failure due to multiple open portals error for the CockroachDB source connector (#10235) • Fixed sync issues from HubSpot to MySQL for

create table

(#10485) octavia thanks Thank you to our awesome contributors! @Titas Skrebė @Koen03 @tbcdns @Philip Corr @Lucas Wiley @Alasdair Brown @Azhar Dewji @jdclarke5 @lshrinivas @zuc @Aaditya S @rfortmann-ewolff @gunu @keterslayter @atorrescogollo @Philippe Boyd @Nahid Oulmi @monai @ron-damon @dpnova

Reminder: It's office hours time!! Join now: https://officehours.airbyte.io

Hey <!channel>! Something big is in the works. Check it out here and make sure to add it to your calendar octavia loves

Hi <!channel>! We have an awesome edition of the Airbyte Community Call taking place tomorrow at 11:00 AM PDT. @Saif Abid from Bitstrapped is going to show off their creation of the Airbyte Golang Connector Development Kit. Through this, he's going to walk through Bistrapped's journey with Airbyte and demo the creation of a Go Airbyte connector. If you're interested in connector development demos, this is definitely one that you don't want to miss. Sign up here to add it to your calendar!

<!channel> We're going live with the Airbyte Community Call ft. @Saif Abid in 10 minutes! Come learn about how to build connectors in Go - Sign up here!

This week, I have a few amazing people in mind that I wanted to recognize octavia loves airbyte heart for the most helpful contributors: @Noel Gomez, @Dan Siegel and @Menno Hamburg 🔥 for the contributors that sparked the most discussion: @Manish Tomar, @Kyle Cheung and @Miquel Rius So thank you!!

Reminder: It's office hours time!! Join now: https://officehours.airbyte.io

📆Calling all San Francisco community members! octavia partyingOctavia would like to invite you to attend Airbyte Launch Week Happy Hour on Thursday, April 7th from 6:00 to 8:00 pm at Fang! We would like to meet community members and share some food, drinks, and laughs. The whole airbyte team will be there. Please register at the link below. See you all in a few weeks. Click here to attend

This week, I have a few amazing people in mind that I wanted to recognize octavia loves airbyte heart for the most helpful contributors: @Noah Kawasaki, @ahsen m and @Jordan Scott 🔥 for the contributors that sparked the most discussion: @Alpana Shukla, @Anton Escalante and @Javier Llorente Mañas So thank you!!

Hey everyone! 👋 <!channel> It’s time we bring this amazing Slack community and our support experience to the next level! We’re making quite a few changes: 1. We’re introducing thematic channels, so like-minded data professionals can help each other by exchanging tips, opinions and use cases. Please welcome the following channels: - #C03908LV5EF - #C0392K9DD6Y - #C038KM9NF7Z - #C038XD02GSZ - #C03909JGQKV - #C039Q2T9JRW - #C038KMW5XKR - #C0390A06EKC - #C03909X3Q3C 2. We also added a few channels that could interest you: - #C039CUNM2QH - #C038XDM83PX if you have any question or suggestion about our community strategy - #C0390ALHFL2 => don't hesitate to add channels for your own cities 3. We will move all support channels to Discourse, so you can easily find past issues that have been resolved. This includes the following: - #C01MFR03D5W => moving to Troubleshooting - #C019WJFR1JT => moving to Product Feedback &amp; Ideas - #C01VDDEGL7M => moving to Connector Development - #C019WEENQRM => moving to Contributing to Airbyte Our open-source user success team will be available on both Discourse and Slack to provide you the best support experience. We hope that you are as excited as we are by these changes and that this Slack will help elevate the data engineering profession!

Hey <!channel>! Here are the patch notes from v0.35.46-alpha to v0.35.62-alpha ⚠️ Breaking changes Importing workspace configurations will fail unless the

EXPOSE_SECRETS_IN_EXPORT=true

flag is set. Warning: Setting the flag will expose your credentials and might introduce a security risk. (#11296) 🚀 New source: Chargify (#10853) (contributed by Javier162380) ✨*New and improved features* • Revamped the Recurly Schema (#9866) • Added the

time_increment

parameter to

custom insight

streams for the FB Marketing source connector (#10531) • Enhanced performance for streams which run substreams for the Stripe source connector (#10359) • Added support for enriching ledger entries with numeric properties for the Orb source connector (#10839) • The Zendesk Support source connector and the Snowflake destination connector now support OAuth (#11162) (#11093) • The Snowflake destination connector is now more scalable with memory usage when working with a large number of streams (#10866) • Primary keys are now set for streams with an

id

for the HubSpot source connector (#11121) • Implement the

BalanceTransactions

stream for the Shopify source connector (#10204) • The GitLab source connector now ingests all accessible groups (#11140) • The S3 destination connector now supports AWS Glue crawler (#11173) • Change buffering for the S3 destination connector to reduce/stabilize memory/thread consumption (#11294) • Added support for the custom reports endpoint for the BambooHR source connector (#11326) • Added

conversation_id

field to

ConversationParts

stream for the Intercom source connector (#11206) 🐛 Bug fixes • Added new

Deployments

,

ProjectColumns

,

PullRequestCommits

,

ProjectCards

streams to the Github source (#10385)(#10766) • Fixed the credit note model for the Chargebee source connector (#10827) • Removed stage history from

deals

stream and handled 10K+ search-endpoint queries for the Hubspot source connector (#10707)(#10700) • Fixed the

Engagement

stream pagination for full refresh and incremental sync modes for the Hubspot source connector. (#11266) • Fixed timestamp cursor for the Snowflake source connector (#10849) • ExternalDB settings are now passed to temporal deployment (#10923) • Improved

SubStream

state handling for the Shopify source connector (#10915) • Secrets are now correctly populated inside nested non-combination objects (#10926) • Added temporary OAuth error handling for the Facebook Marketing source connector (#10917) • Snowflake and Redshift destination connectors no longer have missing records when using S3 staging (#11254) • Incremental syncs for the Intercom source connector are now faster (#11208) • Fixed the campaign stream normalization (#10975) • Decreased normalization event buffer size (#11267) • Fixed a bug that caused the

Tickets

stream to not return removed records in the Zendesk Support source connector (#11349) • Fixed the bucket path for the S3 destination connector (#11496) octavia loves Thank you to our awesome contributors! @Artem Astapenko @Luis Gomez @Danucas @wbchn @Vladimir Remar @Oliver Meyer @Luca Crema @Filipe Banzoli @yannibenoit @Adam Schmidt @Mohamad Hallak @Brian Krausz @Shyngys Nurzhan @Javier Llorente Mañas @Ramon Vermeulen @najustin @Kemp Po @Kshitij Grover @tbcdns @Christian Persson @gavnate @Jasper C @Mohamed Magdy @davidbeckse @Brian Leonard

Reminder: It's office hours time!! Join now: https://officehours.airbyte.io

Hey <!channel>! Airbyte's first ever Launch Week is starting next Monday, 4/4 at 10:00 AM PT. Make sure to check out the details here and add it to your calendar to not miss out on any of the announcements! Looking forward to seeing everyone there octavia loves

This week, I have a few amazing people in mind that I wanted to recognize octavia loves airbyte heart for the most helpful contributors: @Jordan Fox, @Ashwin and @Serhii Chvaliuk [GL] 🔥 for the contributors that sparked the most discussion: @William Phillips, @Manish Tomar and @Kevin Phan So thank you!!

Airbyte's first Launch Week is starting shortly at 10 am PT! Join us live 👉 https://www.youtube.com/channel/UCQ_JWEFzs1_INqdhIO3kmrw octavia loves

We wrapped day 1 ✅. Some details from today's announcements👇 Apply to the Maintainer Program: community rewards beyond bragging rights for helping to create and maintain connectors 💰 CFPs now open for move(data) ✍️: our first conference and dedicated to data engineers Data Bytes 👀: our new content hub! Stay up-to-date with the latest news & discussions around data engineering. This is everything we dropped today: • Behind the scenes of how we built the Maintainer Program • Why we're moving from Slack to Discourse • A recap of all the news we dropped

Day 2 announcements starting shortly!! See y'all at 10 am PT https://www.youtube.com/channel/UCQ_JWEFzs1_INqdhIO3kmrw octavia loves

If you didn't catch our announcement from today you can see it all and give us feedback on Product Hunt --> https://www.producthunt.com/posts/airbyte-cloud-data-movement-platform

Day 3 going live! https://www.youtube.com/channel/UCQ_JWEFzs1_INqdhIO3kmrw octavia loves

If you missed today's session, you can check out our roadmap here --> https://app.harvestr.io/roadmap/view/pQU6gdCyc/airbyte-roadmap let us know what you think!