Release - v0.64.4 New release published by octavia-squidington-iii 8d04d84 Destination databricks: move to intengrations (#45439) 318a237 docs: Fix misspelling

successful

(#45426) 647a3e8 Docs: add note about migrating docker uses external integrations (#45406) 5dbce81 airbyte-ci: improve QA checks for airbyte-enterprise (#45393) a135236 add .kotlin to the .gitignore (#45404) 19335d6 [source-us-census] fix empty fields after sync (#45331) 7056428 Bulk Load CDK: State -> Checkpoint & flush at end (#45377) b00dac8 feat(source-stripe): ref stream

Payment Methods

(#44891) e679191 ✨ Source Sendgrid: Move contacts stream to async declarative component (#45191) e4fec50 bulk-cdk: improve AirbyteConnectorRunner and CliRunner (#45374) 03584d5 [source-mysql/mssql] Fix state manager on determining non-resumable streams (#45181) b6825ee Bulk Load CDK: Simply Interface & Add Check (#45369) 41a242b Remove logging of unhandled debezium events (#45368) e4c26e8 live-test: improve error message when the selected connection did not run the control version (#45335) 8d7b191 [Source-mysql-v2] : Support to add CDC option (#45366) 5761f46 🤖 Cut version 5.5.2 of source-declarative-manifest 9781dd5 🤖 patch bump Python CDK to version 5.5.2 e6659ad airbyte-cdk: poetry lock before release (#45365) b672bc0 Remove pandas from extras in file-based (#45362) e00eaf6 [Source-mysql-v2] : Fix tests to be passing on local (#45363) eb018e6 🤖 Cut version 5.5.1 of source-declarative-manifest 40a7c94 🤖 patch bump Python CDK to version 5.5.1 9bcfa3d source-mysql-v2: set supportLevel to community (#45341) b2e63f2 airbyte-ci: relax docs qa checks when sl == 0 (#45360) c3c8423 .github: fix airbyte-ci-release.yml (#45361) 21348af ref(source-stripe): remove stripe py-package (#45348) ba63c03 feat(source-zendesk-support): add automations and triggers streams (#44610) 8332ddc 🤖 Cut version 5.5.0 of source-declarative-manifest c3048c6 🤖 minor bump Python CDK to version 5.5.0 6baf254 feat(cdk): add async job components (#45178) 254f34a 🤖 Cut version 5.4.0 of source-declarative-manifest 698be7e 🤖 minor bump Python CDK to version 5.4.0 e3ce82e feat(airbyte-cdk): add global_state => per_partition transformation (#45122) bd20b74 🤖 Cut version 5.3.0 of source-declarative-manifest e2d8c23 🤖 minor bump Python CDK to version 5.3.0 41b8585 fix(connector-builder): add flag to disable cache (#45095) 52744ec feat(source-getlago): ignore 405 response for customer usage (#45193) bb1833c Destination Databricks: Create namespace if missing in CHECK (#45208) 58989b0 metadata-service[orchestrator]: avoid "too large" errors in generate_registry_reports (#45336) 7ffcd3d feat(source-shopify): update CDK to v5 (#45190) f216a60 📚 docs: Enable ERDs for 10 top sources. (<https://github.com/airbytehq/airb… airbytehq/airbyte

Hi. Can we have some details on incoming v1.0 of Airbyte ? On announcement page, it's "Coming soon" ... • Is this release going to be deployed immediately on Airbyte Cloud on Sept. 24th ? • What will be the impact on running connections ? • Do you have an overview of the incoming breaking changes ? Thank you for your help

Release - v0.64.5 New release published by octavia-squidington-iii daee3b6 Destination Iceberg: Fix tests to run in airbyte-ci (#45206) 912bc77 docs: add the type: external to the db docs. (#45466) 5cb27b1 source-nylas contribution from topefolorunso (#45093) 86b34f6 source-brevo contribution from btkcodedev (#45382) 1fdd06f source-appfigures contribution from btkcodedev (#45332) 8a4e875 source-shortcut contribution from btkcodedev (#45176) 328fd87 source-survicate contribution from btkcodedev (#45163) 42a26d2 source-buildkite contribution from btkcodedev (#45384) fa67b6a source-front contribution from btkcodedev (#45387) 37af2f0 source-google-tasks contribution from btkcodedev (#45427) a85de6f source-picqer contribution from btkcodedev (#45159) c6530c9 source-teamwork contribution from btkcodedev (#45155) b6deeb3 source-appcues contribution from btkcodedev (#45102) 368b5c2 source-bitly contribution from topefolorunso (#45071) 891fa03 source-guru contribution from btkcodedev (#45066) 56fcf5e source-canny contribution from pabloescoder (#45588) f813e93 source-ezofficeinventory contribution from pabloescoder (#45590) b17df3f Bulk Load CDK: AirbyteType & AirbyteValue, marshaling from json (#45430) ace4e82 Destination CDK: Make DAT open to disable for iceberg (#45602) 91013e1 Bulk Core/Load CDK: Support for connector-type-specific non-config sp… (#45463) 9ae2cbe ✨ feat(Destination PGVector): new connector (#45428) bb1adbe ✨ Source GetLago: feat customer usage (#45452) f6fd017 fix(source-google-search-console): fix request body for report streams by keyword (#45196) 4559c75 🐛Bug(Source hubspot): add missing scope in docs (#45585) 5f2774d 🐙 source-us-census: run up-to-date pipeline [2024-09-14] (#44364) 2c90bca 🐙 source-hubspot: run up-to-date pipeline [2024-09-14] (#45018) 13df95b 🐙 source-chargebee: run up-to-date pipeline [2024-09-14] (#45254) 4a843fa 🐙 source-shopify: run up-to-date pipeline [2024-09-14] (#45255) 3d84c48 🐙 destination-rabbitmq: run up-to-date pipeline [2024-09-14] (#45293) 5642f2c 🐙 source-unleash: run up-to-date pipeline [2024-09-14] (#45295) 917708d 🐙 source-webflow: run up-to-date pipeline [2024-09-14] (#45296) 77e18da 🐙 source-recurly: run up-to-date pipeline [2024-09-14] (#45471) cd546bd 🐙 source-orb: run up-to-date pipeline [2024-09-14] (#45472) 77db6ec 🐙 source-mixpanel: run up-to-date pipeline [2024-09-14] (#45473) d052a8a 🐙 source-apple-search-ads: run up-to-date pipeline [2024-09-14] (#45474) c27f183 🐙 source-younium: run up-to-date pipeline [2024-09-14] (#45475) 107911a 🐙 source-greenhouse: run up-to-date pipeline [2024-09-14] (#45476) d73fac7 🐙 source-snapchat-marketing: run up-to-date pipeline [2024-09-14] (<https://github.… airbytehq/airbyte

Release - v0.64.6 New release published by octavia-squidington-iii 6502f92 🐛 Source Greenhouse: faster check stream (#45625) 4027d0e [docs] add troubleshooting abctl page + move trb. from quickstarts (#45460) 28f8214 🤖 Cut version 5.6.0 of source-declarative-manifest c5cff57 🤖 minor bump Python CDK to version 5.6.0 199a807 [airbyte-cdk] Decouple request_options_provider from datetime_based_cursor + concurrent_cursor features for low-code (#45413) airbytehq/airbyte

Release - v0.64.7 New release published by octavia-squidington-iii 2e62443 [source-postgres/mysql/mssql/mongodb-v2] Use latest CDK to adopt latest apache sshd mina to handle tcpkeepalive requests (#45639) 398a1bb source-buzzsprout contribution from btkcodedev (#45608) ed214d0 [cdk] upgrade apache mina sshd to 2.13.2 to handle openssh tcpkeepalive request (#45638) 5f93772 [ISSUE_TEMPLATE] replace deprecated docker template for ai-assist (#45629) 6d74db7 change signature of orphanedThreadFilter (#45469) 6469111 [source-mysql-v2] cdk and spec change for ssl (#45351) airbytehq/airbyte

Release - Airbyte 1.0 New release published by bgroff airbyte v1.0.0 This page includes new features and improvements to the Airbyte products we're excited to share as a part of the 1.0 release. Airbyte v1.0 contains many improvements and additions to enhance the reliability, scalability, and uses of Airbyte. Moving forward, Airbyte will release official new platform versions on a monthly cadence, with the associated changelog. Ease of deployment • `abctl` is the easiest, quickest way to get started with Airbyte Self-managed. See our </airbytehq/airbyte/blob/v1.0.0/using-airbyte/getting-started/oss-quickstart#2-run-airbyte|quickstart docs> for more details. • </airbytehq/airbyte/blob/v1.0.0/deploying-airbyte/integrations/authentication|Native authentication> by email and password is available so that any instance of Airbyte is secure by default. Proven Reliability • Automatic detection of dropped records ensures data is passed without fail through the Airbyte platform. • Enhanced our notification suite to enable webhook integrations and added more contextual information about sync failures or schema changes. • Connections now offer rate limited messaging, improved error handling, and live monitoring of ongoing syncs. </airbytehq/airbyte/blob/v1.0.0/assets/full-status-page.png|Status Page> • Many sources, in particular S3, have become faster. With CDK 2.0, the protocol now uses Pydantic V2 and removes the serialization of each record. We also improved Databricks and S3 destinations to enable faster sync speeds, checkpointing, and modernization to our Destinations V2 framework. Resiliency at Scale • </airbytehq/airbyte/blob/v1.0.0/operator-guides/refreshes|Refreshes> bring an improved experience to resyncing all of your data again. This enables data to never be deleted from final tables during a historical resyncing of data. • Resumable Full Refresh allows for large streams syncing in Full Refresh to sync without failures. • Our database sources added </airbytehq/airbyte/blob/v1.0.0/operator-guides/refreshes#resumability|resumability> to reduce failures and stay resilient when incoming data is inconsistent. We gracefully handle record-level error in the destination field

_airbyte_meta.errrors

for large records or mistyped data. Read more in our </airbytehq/airbyte/blob/v1.0.0/using-airbyte/core-concepts/typing-deduping#_airbyte_meta-errors|typing & deduping documentation>. • Large initial CDC syncs are gracefully handled by consuming WAL and acknowledges logs periodically to ensure disk space is freed in a timely manner. • </airbytehq/airbyte/blob/v1.0.0/understanding-airbyte/jobs#workloads|Workloads> provide a more scalable and reliable architecture to run sync jobs by separating scheduling and orchestration from data movement tasks. This improvement unlocks more automated management of workloads by managing job spikes and enables horizonal scaling (for Cloud and Enterprise users). Tackling the long-tail of connectors • We launched our connector Marketplace for our community-maintained connectors. Automated testing ensures our connectors stay high quality, and most connectors have been migrated to low/no-code. • The Connector Builder seamlessly switches betweem UI and YAML modes, supports custom components, and contains extensive testing and error handling. • AI Assist now builds connectors from scratch for you with just a link to the API docs. • Anyone can now contribute new connectors directly from the builder to add a new connector directly to Airbyte's Marketplace. Additionally, connectors can be forked directly from the UI for faster edits, ensuring our connectors stay up-to-date. • Airbyte supports writing to several vector store destinations, including pgVector, Pinecone, and Snowflake Cortex. Self-Managed Enterprise Self-Managed Enterprise extends on Airbyte 1.0 by introducing new classes of functionality: multitenancy and access management, enterprise source connectors , sensitive data masking and enterprise support – all while data never leaves your infrastructure. • Support for Okta and OpenID Connect (OIDC) SSO • Availability of </airbytehq/airbyte/blob/v1.0.0/access-management/rbac|Role-based Access Control> and multitenancy • Columns can now be hashed to protect sensitive data Announcements • To ensure adherence to security best practices, Airbyte is migrating all connectors to non-root versions. It is highly recommended that you upgrade your platform version to v0.63.9 or later before October 2024 to ensure your syncs continue to succeed. • As we prepare to deprecate Docker Compose, we published a </airbytehq/airbyte/blob/v1.0.0/using-airbyte/getting-started/oss-quickstart#migrating-from-docker-compose-optional|migration guide> for those migrating from Docker Compose to abctl. airbytehq/airbyte

Where do you go to see the version of the helm chart with Airbyte 1.0 in it?

Release - Airbyte 1.1.0 New release published by bgroff 🚀 Features The 1.1.0 release includes the following enhancements and bug fixes. Platform Releases • Adds field hashing for Self-Managed Enterprise • Adds the </airbytehq/airbyte/cloud/managing-airbyte-cloud/review-connection-timeline|Connection Timeline>, replacing the Job History for a connection. For assistance with the migration of existing jobs to the new timeline events, follow our guide. • Redesigned the schema tab to improve the selection & deselection of streams and fields. Sync modes, cursor fields, and primary keys are also selected here. • Custom Docker-based connectors can now be renamed and deleted Support Experience • Diagnostics can be downloaded through the Organization Settings page, which will export a JSON file to facilitate sharing with Support. This JSON file includes relevant infrastructure and connection information. (Self-Managed Enterprise only) Billing & Licenses • Self-Managed Enterprise users can now view directly in the UI when the license is expiring. Changelog See the Full Changelog airbytehq/airbyte

airbyte rocket Connector Builder now supports XML responses and HTTP response format selection! We're excited to introduce XML support, along with the ability to select different HTTP response formats in Connector Builder. Want to see it in action? Check out the documentation for a short video or try it out directly in the Connector Builder.

Release - Airbyte 1.2.0 New release published by bgroff Happy Halloween! We are excited to release the following set of improvements and changes. 🚀 Platform Changes • File Transfers: Airbyte now supports transfering unstructured text data, non-text data and compressed files. This capability is in early access, and currently only available for moving data from the "SFTP Bulk" source to the "S3" destination. Support in the "S3" source is coming soon. File transfers allow you to copy raw files in Airbyte without parsing their contents. Bits are copied into the destination exactly as they appeared in the source. This is recommended for use with unstructured text data, non-text and compressed files. This is an entirely new way of moving data through Airbyte, as all pre-existing data movement methods involved parsing individual records. • Custom Image Registry Support: Introduces support for specifying a custom Docker registry from which all platform images are pulled. This should simplify helm chart configurations for users who require images to be pulled from internally approved image repositories. Configuring the following will prefix all docker images with

<http://my-registry.foo.com|my-registry.foo.com>

. The value provided in the

registry

field must have a trailing slash: global: image: registry: my-registry.foo.com/ • XML Support in the Connector Builder: Airbyte now supports custom API connectors built via the Airbyte Connector Builder which return responses as XML format. 🚀 Self-Managed Enterprise Changes • Runner RBAC Role: Users provisioned with the 'Runner' role are able to start or stop syncs, and run backfills for individual connections (in the workspaces where they've been granted Runner permissions). Outside of these explicit tasks, users with the 'Runner' role have an entirely read-only experience (Self-Managed Enterprise only). • Self-Managed Diagnostics: Diagnostics have been expanded to include deployment statistics. Diagnostics can be downloaded through the Organization Settings page. This exports a .zip file which can be easily shared with Airbyte Support (Self-Managed Enterprise only). • Removing SSO Users: You may now remove SSO users from your Airbyte Organization. This removes them from the list of Organization Members. airbytehq/airbyte

has renamed the channel from "releases-and-early-demos" to "releases"

set the channel topic: Get updates from Airbyte releases.

Release - Airbyte 1.3.0 New release published by bgroff It's already December! We are excited to release the following set of improvements and changes. 🚀 Platform Changes • Improved Log Viewer and Filtering: You can now quickly filter to error or warning logs when needed, as well as by log source - such as the source connector, destination connector, or platform. Together, this allows you to quickly diagnose issues with Airbyte connections if they arise, reducing time to resolution on issues. • OpenShift Support: Starting today, Airbyte supports deployments to OpenShift. This is the culmination of a journey over much of the past year: we've updated our platform and connectors to be rootless, we've improved pod to pod communication within our platform, and made a wide number of security improvements. To succeed, the user running helm deployment commands needs to be a

cluster-admin

user. Your Kubernetes namespace will also require the following annotations to ensure that all of the Airbyte resources run as UID 1000 and GID 1000. If you run into any edge cases or issues deploying to OpenShift, as always, please let us know by opening a GitHub issue. openshift.io/sa.scc.supplemental-groups: 1000/1 openshift.io/sa.scc.uid-range: 1000/1 🚀 Self-Managed Enterprise Changes • Compliance Mappers in Airbyte API: Airbyte Self-Managed Enterprise now supports field hashing, field encryption (with self-managed encryption keys), field renaming and row filtering for connections from a common interface available in the Airbyte API. This functionality is coming soon to the Airbyte UI. To get started, see our API documentation. airbytehq/airbyte

connector builder New Connector Builder Feature: Interpolation Menus connector builder A menu listing and describing available variables, macros, filters, and user inputs is now shown when creating interpolated expressions in a Builder field. See this loom for a full demo: https://www.loom.com/share/d729569da61e4288bd1c46bb68976c48?sid=103f750d-6eca-4f50-813a-38f8a425eb99 And the screenshots below for a peek at what this looks like in-app.

hello, where can I find changes in the new Helm chart release

1.3.1

? 🙏 I can not see any changelog thanks 🙂

Hey all -- I'm wondering when is 1.3.2 scheduled to be released? (I'm waiting for this bug fix) thanks for the help in advance 🙏

hey yall 😄 when will 0.53.0 for the airbyte-api be released? im waiting for the connectionsyncmodeenum to include

full_refresh_overwrite_deduped

Hi, I'm waiting for the CDK version to be upgraded to >6.24.0 in

airbyte-platform

. The current version on the main branch is 6.36.3 but in the latest 1.5.0 release of airbyte the CDK version is still on 6.13. Does anyone know when the CDK upgrade will be released?

Hello, do you have detailed changelog about the new release 1.6.0 ? 🙏 They have been pushed here and here with no more element. Thank you

What is the purpose of the v2 folder in the airbyte chart? Does https://github.com/airbytehq/airbyte-platform/tree/main/charts/v2/airbyte or https://github.com/airbytehq/airbyte-platform/tree/main/charts/airbyte constitute the most recent version of Airbyte?

Is anybody experiencing issues with release 1.7.0? Our cluster decided to die after it upgraded

Hi, how can I run Airbyte OSS over HTTP? Apparently the section is missing and using the flag

--insecure-cookies

when installing with abctl doesn't work anymore... https://docs.airbyte.com/platform/using-airbyte/getting-started/oss-quickstart#running-over-http

We are dropping Airbyte and moving to nifi

Please test the performance before adapting Airbyte. It wasted our efforts and impression to clients!!

For those experiencing authentication issues with the Connector Builder in 1.7, please see the fix and details here: https://docs.airbyte.com/release_notes/v-1.7#171. There is some further discussion in GitHub about this. See https://github.com/airbytehq/airbyte/issues/61677#issuecomment-3046489964.

Hello, currently working on AirByte Embedded setup. Are there any plans to support GCP destinations for embedded?

Hello, Are there any plans to support postgresql

jsonb

type ? It's actually parsed and loaded into S3 as

string

type. We have more and more use case of providers and tables from our internal backend db using this type of field. We 're apparently not the only ones facing this challenge (https://airbytehq.slack.com/archives/C021JANJ6TY/p1713996557175259). Bests,

I just tried to upgrade our Community Airbyte and ended up with the following disaster (fortunately I have snapshots!)

INFO    Using Kubernetes provider:
            Provider: kind
            Kubeconfig: /root/.airbyte/abctl/abctl.kubeconfig
            Context: kind-airbyte-abctl
 SUCCESS  Found Docker installation: version 28.3.3
 SUCCESS  Existing cluster 'airbyte-abctl' found
 SUCCESS  Cluster 'airbyte-abctl' validation complete
 WARNING  Found MinIO physical volume. Consider migrating it to local storage (see project docs)
 WARNING  Psql 13 detected. Consider upgrading to 17
  INFO    Pulling image airbyte/connector-builder-server:1.8.1
  INFO    Pulling image airbyte/cron:1.8.1
  INFO    Pulling image airbyte/server:1.8.1
  INFO    Pulling image airbyte/worker:1.8.1
  INFO    Pulling image airbyte/workload-api-server:1.8.1
  INFO    Pulling image airbyte/workload-launcher:1.8.1
  INFO    Pulling image temporalio/auto-setup:1.27.2
  INFO    Namespace 'airbyte-abctl' already exists
  INFO    Persistent volume 'airbyte-minio-pv' already exists
  INFO    Persistent volume claim 'airbyte-minio-pv-claim-airbyte-minio-0' already exists
  INFO    Persistent volume 'airbyte-volume-db' already exists
  INFO    Persistent volume claim 'airbyte-volume-db-airbyte-db-0' already exists
  INFO    Starting Helm Chart installation of 'airbyte/airbyte' (version: 2.0.10)
  ERROR   Failed to install airbyte/airbyte Helm Chart
  ERROR   Unable to install Airbyte locally
  ERROR   unable to install airbyte chart: unable to install helm: cannot patch "airbyte-abctl-connector-builder-server" with kind Deployment: Deployment.apps "airbyte-abctl-connector-builder-server" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"airbyte":"connector-builder-server", "<http://app.kubernetes.io/instance|app.kubernetes.io/instance>":"airbyte-abctl", "<http://app.kubernetes.io/name|app.kubernetes.io/name>":"connector-builder-server"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable && cannot patch "airbyte-abctl-cron" with kind Deployment: Deployment.apps "airbyte-abctl-cron" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"airbyte":"cron", "<http://app.kubernetes.io/instance|app.kubernetes.io/instance>":"airbyte-abctl", "<http://app.kubernetes.io/name|app.kubernetes.io/name>":"cron"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable && failed to create patch: The order in patch list:...

Hi Guys I was trying to find the frontend code of Airbyte in the latest-release The documentation said that it should be inside a folder named web-app but there wasn't any Does anyone have an idea on where could we find this

Hi everyone, I'd like to know about the progress of the Java CDK. I'm planning to update/develop a destination for a database. I noticed that Airbyte's destination development documentation mentions 'The template for building a Java Destination connector is currently unavailable. The Airbyte team is working on revamping the Java CDK.' and 'A new CDK destination v2 is planned for release in 2024.' This confuses me. Is there a stable and available Java CDK for developing destinations at this stage? Is this documentation still valid? https://docs.airbyte.com/platform/connector-development/tutorials/building-a-java-destination