John (Airbyte)
Upon upgrading to v0.39 of Airbyte, OSS deployments will be migrated to the new temporal-based scheduler, which we described in detail in this blog post: https://airbyte.com/blog/scale-workflow-orchestration-with-temporal
This change brings the following improvements to OSS deployments of Airbyte:
• More reliable and efficient scheduling of large-scale OSS deployments. Airbyte deployments that used to struggle to schedule the syncs of thousands of connections on time should now see consistent scheduling performance.
• Some of the newest reliability features, such as automatic connection checks before syncs, are added only to the temporal-based scheduler implementation, as the old scheduler implementation has been deprecated and will soon be removed entirely. So all OSS users will see these new features upon upgrading.
• This upgrade should not require any special new action from users. Users should upgrade as they normally do, by spinning down their existing deployment and spinning back up on the new version, as described in the docs.🚀 Upgraded to GA: • Source: Intercom • Destination: Amazon S3 🚀 Upgraded to Beta: • Source: Amazon Ads • Source: Google Search Console 🚀 New connectors in Alpha: • Destination: Google Sheets • Destination: Databricks --- Check the thread to see all the patch notes, features and bug fixes, there are a lot of them! And don't hesitate to ask questions there, we'll be happy to answer 🙂 . Thank you to our awesome contributors! @gunu, @ROBERTO BONNET, sivankumar86, nahal99, @Zawar khan, manescianera, @Pedro Calleja, @Adam Bloom, NioccoloSalvini, @Peter Li, wjwatkinson, @Mohit Reddy, Anushree-Agrawal
John (Airbyte)
Chandu P
05/25/2022, 8:27 PMJohn (Airbyte)