https://linen.dev logo
Join Slack
Powered by
As usual, it's patch notes time <!channel>! We're ...
# announcements
a
As usual, it's patch notes time <!channel>! We're going over the changes from 
0.29.17
and before... and we're doing things a little differently this week, as there are a LOT of big updates that we want you to focus on: all the bugfixes will be attached in the thread on this announcement, so open the thread if you want to see them. Without further ado... New Source: Facebook Pages New Destination: MongoDB New Destination: DynamoDB • 💎 You can now send notifications via webhook for successes and failures on Airbyte syncs. This means that you can now set up external apps that let you know about the status of your Airbyte syncs without any hassle. (This is a massive contribution by @Pras, thank you) 🎉 • 💎 Scheduling jobs and worker jobs are now separated, allowing for workers to be scaled horizontally. To be specific, this means that you can now orchestrate thousands of simultaneous jobs on K8s if you so desire (make sure to update your docker-compose file for this to work). • 🎉 When developing a connector, you can now preview what your spec looks like in real time with this process. • 🎉 Oracle destination: Now has basic normalization. • 🎉  Added XLSB (binary excel) support to the Files source (contributed by Muutech). • 🎉 You can now properly cancel K8s deployments. • ✨ S3 source: Support for Parquet format. • ✨  Github source: Branches, repositories, organization users, tags, and pull request stats streams added (contributed by @Christopher Wu). • ✨ BigQuery destination: Added GCS upload option. • ✨ Salesforce source: Now Airbyte native. • ✨ Redshift destination: Optimized for performance. • 🏗️ CDK: 💎 We’ve released a tool to generate JSON Schemas from OpenAPI specs. This should make specifying schemas for API connectors a breeze! 💎 • 🏗️ CDK: Source Acceptance Tests now verify that connectors correctly format strings which are declared as using 
date-time
 and 
date
 formats. • 🏗️ CDK: Add private options to help in testing: 
_limit
 and 
_page_size
 are now accepted by any CDK connector to minimze your output size for quick iteration while testing. As usual... thank you to our wonderful contributors this week: @Pras, @Christopher Wu, @Brian M, @yahu98, @zuc, @jinnig, and @luizgribeiro!
❤️ 1
airbyte rocket 15
🙌 4
party parrot 1
airbyte star 5
octavia rocket 5
👍 6
🎉 38
• 🐞 Fixed a bug that made it possible for connector definitions to be duplicated, violating uniqueness. • 🐛 Pipedrive source: Output schemas no longer remove timestamp from fields. • 🐛 Github source: Empty repos and negative backoff values are now handled correctly. • 🐛 Harvest source: Normalization now works as expected. • 🐛 All CDC sources: Removed sleep logic which caused exceptions when loading data from high-volume sources. • 🐛 Slack source: Increased number of retries to tolerate flaky retry wait times on the API side. • 🐛 Slack source: Sync operations no longer hang indefinitely. • 🐛 Jira source: Now uses updated time as the cursor field for incremental sync instead of the created time. • 🐛 Intercom source: Fixed inconsistency between schema and output data. • 🐛 Hubspot source: Streams with the 
items
property now have their schemas fixed. • 🐛 Hubspot source: Empty strings are no longer handled as dates, fixing the 
deals
, 
companies
, and 
contacts
streams. • 🐛 Typeform source: Allows for multiple choices in responses now. • 🐛 Shopify source: The type for the 
amount
field is now fixed in the schema. • 🐛 Postgres destination: 
\u0000(NULL)
value processing is now fixed.
🎉 8
👍 1
m
Amazing!!!
r
Hi Abhi, I think slack connector is not fixed, it is still hanging when it comes to retrieve messages : • 🐛 Slack source: Increased number of retries to tolerate flaky retry wait times on the API side. • 🐛 Slack source: Sync operations no longer hang indefinitely. Where can I follow these bugs ?
u
@Romain LOPEZ version 0.1.11 of Slack connector should solve this. https://github.com/airbytehq/airbyte/pull/5830 could you check and validate it?
m
@Jiyuan Zheng horizontal scaling ^^
🎉 1
2 Views
Open in Slack
PreviousNext
Powered by