Anita Sandoval
Octavia Squidington III
11/22/2021, 4:10 PM[DEPRECATED] Augustin Lafanechere
v.32.5
and prior!
🎃 *Hacktoberfest Submission*s 🎃
-----------------------------------------
🎉 New Source: Airtable (contributed by @Tuan Nguyen).
🎉 New Source: Notion (contributed by @Bo).
🎉 New Source: Pardot (contributed by @Tuan Nguyen).
(⏰ Remaining Hacktoberfest PRs will be reviewed and counted if submitted on 11/19 or before!)
-----------------------------------------
🎉 New Source: Youtube analytics
✨ Source Exchange Rates: add ignore_weekends
option.
✨ Source Facebook: add the videos stream.
✨ Source Freshdesk: removed the limitation in streams pagination.
✨ Source Jira: add option to render fields in HTML format.
✨ Source MongoDB v2: improve read performance.
✨ Source Pipedrive: specify schema for "persons" stream.
✨ Source PostgreSQL: exclude tables on which user doesn't have select
privileges.
✨ Source Survey Monkey: improve connection check.
🐛 Source Salesforce: improve resiliency of async bulk jobs.
🐛 Source Zendesk Support: fix missing ticket_id
in ticket_comments
stream.
🐛 Normalization: optimize incremental normalization runtime with Snowflake.
As usual, thank you so much to our wonderful contributors this week that have made Airbyte into what it is today: @Madison Swain-Bowden, @Tuan Nguyen, @Bo, @Adam Dobrawy, @Christopher Wu, @Luis Gomez, @Ivica Taseski, @Mario Molina, @Ping, @koji matsumoto, @Sujit Sagar, @Shadab, @Juozas and @Serhii Chvaliuk [GL]!Slackbot
12/01/2021, 6:59 PMabhi
12/02/2021, 11:27 PMv.0.32.6
to v.0.32.8
.
⚠️ Reminder about v.0.32.XX
⚠️
A friendly reminder that if you haven't upgraded to v.0.32.XX
, please follow these instructions to do so safely, as it's a major version bump with breaking changes.
🎆 --- Hacktoberfest Rewards Update --- 🎆
As a quick update for those who participated in our Hacktoberfest, connector development rewards will start going out next week, so keep an eye out for a DM from me!
If you submitted your PR on or before 11/19, don't worry if you don't hear from me next week, you will still receive a reward once it's merged!
🎃 Hacktoberfest Submissions 🎃
-----------------------------------------
New Destination: Redis (contributed by @Ivica Taseski)
New Destination: MQTT (contributed by @Mario Molina)
New Destination: Google Firestore (contributed by @Adam Dobrawy)
New Destination: Kinesis (contributed by @Ivica Taseski)
New Source: Zenloop (contributed by @Alexander Batoulis)
New Source: Outreach (contributed by @Luis Gomez)
✨ Zendesk Source: The chats
stream now supports incremental sync and added testing for all streams.
🐛 Monday Source: Pagination now works as expected and the schema has been fixed.
🐛 Postgres Source: Views are now properly listed during schema discovery.
🐛 Postgres Source: Using the money
type with an amount greater than 1000 works properly now.
🐛 Google Search Console Search: We now set a default end_data
value.
🐛 Mixpanel Source: Normalization now works as expected and streams are now displayed properly in the UI.
🐛 MongoDB Source: The DATE_TIME
type now uses milliseconds.
Our contributors are awesome. Here are all of the people that have helped us progress in the last week: @Ivica Taseski, @Mario Molina, @Adam Dobrawy, @Alexander Batoulis, @Luis Gomez, @Harsha Teja Kanna, @Aaron Kawalsky, @erdenezul, and @Juozas!Octavia Squidington III
12/06/2021, 4:01 PMSlackbot
12/08/2021, 6:59 PMAnita Sandoval
Octavia Squidington III
12/13/2021, 5:34 PMSlackbot
12/15/2021, 6:59 PMabhi
12/17/2021, 10:29 PMv0.33.7
to v0.34.1
. Lots of big stuff, stay tuned!
💎 🎉 First off... There's a brand new CDK! @Menno Hamburg contributed a .NET/C# implementation for our CDK, allowing you to write HTTP API sources and Generic Dotnet sources. Thank you so much Menno, this is huge! 💎 🎉
New Source: OpenWeather (contributed by us - @[DEPRECATED] Augustin Lafanechere octavia loves)
New Destination: ClickHouse (contributed by @Bo)
New Destination: RabbitMQ (contributed by @Luis Gomez)
New Destination: Amazon SQS (contributed by @Alasdair Brown)
New Destination: Rockset (contributed by @Steve Baldwin)
✨ Facebook Marketing Source: Updated the campaign
schema with more relevant fields. (contributed by @Maxime Lavoie)
✨ TikTok Marketing Source: Now supports the Basic Report
stream.
✨ MySQL Source: Now supports all MySQL 8.0 data types.
✨ Klaviyo Source: Improved performance, added incremental sync support to the Global Exclusions
stream.
✨ Redshift Destination: You can now specify a bucket path to stage your data in before inserting.
party k8s Kubernetes deployments: Sidecar memory is now 25Mi
, up from 6Mi
to cover all usage cases.
party k8s Kubernetes deployments: The Helm chart can now set up writing logs to S3 easily. (contributed by @Valentin Nourdin)
🐛 Fixed an issue where connector secret fields in nested configurations could be returned by the API (For security, we highly recommend upgrading to 0.34.1
to pull this change in).
🐛 Python CDK: Now shows the stack trace of unhandled exceptions.
🐛 Google Analytics Source: Fix data window input validation, fix date type conversion.
🐛 Google Ads Source: Data from the end_date
for syncs is now included in a sync.
🐛 Marketo Source: Fixed issues around input type conversion and conformation to the schema.
🐛 Mailchimp Source: Fixed schema conversion error causing sync failures.
🐛 PayPal Transactions Source: Now reports full error message details on failure.
🐛 Shopify Source: Normalization now works as expected.
Thank you as usual to all of our contributors this week: @Steve Baldwin, @Maciej Nędza, @cina-pm, @Brian Krausz, @James Wilson, @Menno Hamburg, @Shadab, @Bo, @Luis Gomez, @Maxime Naulleau, @Valentin Nourdin, @gunu, and @Alasdair Brown!Octavia Squidington III
12/20/2021, 4:00 PMSlackbot
12/22/2021, 6:59 PMSlackbot
12/29/2021, 6:59 PMAnita Sandoval
Octavia Squidington III
01/03/2022, 5:23 PMAndy Yeo (Airbyte)
Slackbot
01/05/2022, 6:59 PMAnita Sandoval
Octavia Squidington III
01/10/2022, 4:01 PMSlackbot
01/12/2022, 6:59 PMabhi
01/14/2022, 2:27 AM0.35.4
to 0.35.5
.
🚨 Snowflake Source: Normalization with Snowflake now produces permanent tables. [If you want to continue creating transient tables, you will need to create a new transient database for Airbyte.]
✨ GitHub Source: PR related streams now support incremental sync.
✨ HubSpot Source: We now support ListMemberships
in the Contacts
stream.
✨ Azure Blob Storage Destination: Now has the option to add a BufferedOutputStream
to improve performance and fix writing data with over 50GB in a stream. (contributed by @bmatticus)
🐛 Normalization partitioning now works as expected with FLOAT64
and BigQuery.
🐛 Normalization now works properly with quoted and case sensitive columns.
🐛 Source MSSQL: Added support for some missing data types.
🐛 Snowflake Destination: Schema is now not created if it previously exists.
🐛 Postgres Source: Now properly reads materialized views.
🐛 Delighted Source: Pagination for survey_responses
, bounces
and unsubscribes
streams now works as expected.
🐛 Google Search Console Source: Incremental sync now works as expected.
🐛 Recurly Source: Now does not load all accounts when importing account coupon redemptions.
🐛 Salesforce Source: Now properly handles 400
when streams don't support query
or queryAll
.
Thank you to all of our awesome contributors that merged code in the last week!
@Mohamed Magdy, @Michael Guarino, @Anuj Gupta, @bmatticus, @Juozas, @Harsha Teja Kanna, @Christopher Wu, @Christian Persson, and @Tal Elishoov!Anita Sandoval
Octavia Squidington III
01/17/2022, 4:02 PMSlackbot
01/19/2022, 6:59 PMSlackbot
01/26/2022, 6:59 PMOctavia Squidington III
02/01/2022, 9:54 AMSlackbot
02/02/2022, 6:59 PMOctavia Squidington III
02/07/2022, 4:30 PMSlackbot
02/09/2022, 6:59 PM