https://linen.dev logo
Join Slack
Powered by
# releases
  • m
    Where do you go to see the version of the helm chart with Airbyte 1.0 in it?
    u
    • 2
    • 2
  • u
    Release - Airbyte 1.1.0 New release published by bgroff 🚀 Features The 1.1.0 release includes the following enhancements and bug fixes. Platform Releases • Adds field hashing for Self-Managed Enterprise • Adds the </airbytehq/airbyte/cloud/managing-airbyte-cloud/review-connection-timeline|Connection Timeline>, replacing the Job History for a connection. For assistance with the migration of existing jobs to the new timeline events, follow our guide. • Redesigned the schema tab to improve the selection & deselection of streams and fields. Sync modes, cursor fields, and primary keys are also selected here.

    Schema Tab▾

    • Custom Docker-based connectors can now be renamed and deleted Support Experience • Diagnostics can be downloaded through the Organization Settings page, which will export a JSON file to facilitate sharing with Support. This JSON file includes relevant infrastructure and connection information. (Self-Managed Enterprise only) Billing & Licenses • Self-Managed Enterprise users can now view directly in the UI when the license is expiring. Changelog See the Full Changelog airbytehq/airbyte
  • p
    airbyte rocket Connector Builder now supports XML responses and HTTP response format selection! We're excited to introduce XML support, along with the ability to select different HTTP response formats in Connector Builder. Want to see it in action? Check out the documentation for a short video or try it out directly in the Connector Builder.
    q
    j
    +3
    • 6
    • 6
  • u
    Release - Airbyte 1.2.0 New release published by bgroff Happy Halloween! We are excited to release the following set of improvements and changes. 🚀 Platform Changes • File Transfers: Airbyte now supports transfering unstructured text data, non-text data and compressed files. This capability is in early access, and currently only available for moving data from the "SFTP Bulk" source to the "S3" destination. Support in the "S3" source is coming soon. File transfers allow you to copy raw files in Airbyte without parsing their contents. Bits are copied into the destination exactly as they appeared in the source. This is recommended for use with unstructured text data, non-text and compressed files. This is an entirely new way of moving data through Airbyte, as all pre-existing data movement methods involved parsing individual records.

    file-transfers-sftp-bulk-source▾

    • Custom Image Registry Support: Introduces support for specifying a custom Docker registry from which all platform images are pulled. This should simplify helm chart configurations for users who require images to be pulled from internally approved image repositories. Configuring the following will prefix all docker images with 
    <http://my-registry.foo.com|my-registry.foo.com>
    . The value provided in the 
    registry
    field must have a trailing slash: global: image: registry: my-registry.foo.com/ • XML Support in the Connector Builder: Airbyte now supports custom API connectors built via the Airbyte Connector Builder which return responses as XML format.

    xml-builder▾

    🚀 Self-Managed Enterprise Changes • Runner RBAC Role: Users provisioned with the 'Runner' role are able to start or stop syncs, and run backfills for individual connections (in the workspaces where they've been granted Runner permissions). Outside of these explicit tasks, users with the 'Runner' role have an entirely read-only experience (Self-Managed Enterprise only).

    rbac-1.2▾

    • Self-Managed Diagnostics: Diagnostics have been expanded to include deployment statistics. Diagnostics can be downloaded through the Organization Settings page. This exports a .zip file which can be easily shared with Airbyte Support (Self-Managed Enterprise only). • Removing SSO Users: You may now remove SSO users from your Airbyte Organization. This removes them from the list of Organization Members. airbytehq/airbyte
    b
    • 2
    • 1
  • u
    has renamed the channel from "releases-and-early-demos" to "releases"
  • u
    set the channel topic: Get updates from Airbyte releases.
  • u
    Release - Airbyte 1.3.0 New release published by bgroff It's already December! We are excited to release the following set of improvements and changes. 🚀 Platform Changes • Improved Log Viewer and Filtering: You can now quickly filter to error or warning logs when needed, as well as by log source - such as the source connector, destination connector, or platform. Together, this allows you to quickly diagnose issues with Airbyte connections if they arise, reducing time to resolution on issues.

    Improved Log Viewer▾

    • OpenShift Support: Starting today, Airbyte supports deployments to OpenShift. This is the culmination of a journey over much of the past year: we've updated our platform and connectors to be rootless, we've improved pod to pod communication within our platform, and made a wide number of security improvements. To succeed, the user running helm deployment commands needs to be a 
    cluster-admin
    user. Your Kubernetes namespace will also require the following annotations to ensure that all of the Airbyte resources run as UID 1000 and GID 1000. If you run into any edge cases or issues deploying to OpenShift, as always, please let us know by opening a GitHub issue. openshift.io/sa.scc.supplemental-groups: 1000/1 openshift.io/sa.scc.uid-range: 1000/1 🚀 Self-Managed Enterprise Changes • Compliance Mappers in Airbyte API: Airbyte Self-Managed Enterprise now supports field hashing, field encryption (with self-managed encryption keys), field renaming and row filtering for connections from a common interface available in the Airbyte API. This functionality is coming soon to the Airbyte UI. To get started, see our API documentation.

    Mappers API Example▾

    airbytehq/airbyte
    k
    • 2
    • 1
  • l
    connector builder New Connector Builder Feature: Interpolation Menus connector builder A menu listing and describing available variables, macros, filters, and user inputs is now shown when creating interpolated expressions in a Builder field. See this loom for a full demo: https://www.loom.com/share/d729569da61e4288bd1c46bb68976c48?sid=103f750d-6eca-4f50-813a-38f8a425eb99 And the screenshots below for a peek at what this looks like in-app.
    q
    m
    j
    • 4
    • 5
  • k
    hello, where can I find changes in the new Helm chart release 
    1.3.1
    ? 🙏 I can not see any changelog thanks 🙂
    u
    b
    j
    • 4
    • 10
  • a
    Hey all -- I'm wondering when is 1.3.2 scheduled to be released? (I'm waiting for this bug fix) thanks for the help in advance 🙏
    u
    b
    h
    • 4
    • 5
  • m
    hey yall 😄 when will 0.53.0 for the airbyte-api be released? im waiting for the connectionsyncmodeenum to include 
    full_refresh_overwrite_deduped
  • w
    Hi, I'm waiting for the CDK version to be upgraded to >6.24.0 in 
    airbyte-platform
    . The current version on the main branch is 6.36.3 but in the latest 1.5.0 release of airbyte the CDK version is still on 6.13. Does anyone know when the CDK upgrade will be released?
    • 1
    • 1
  • k
    Hello, do you have detailed changelog about the new release 1.6.0 ? 🙏 They have been pushed here and here with no more element. Thank you
    p
    j
    w
    • 4
    • 22
  • r
    What is the purpose of the v2 folder in the airbyte chart? Does https://github.com/airbytehq/airbyte-platform/tree/main/charts/v2/airbyte or https://github.com/airbytehq/airbyte-platform/tree/main/charts/airbyte constitute the most recent version of Airbyte?
    i
    p
    • 3
    • 2
  • c
    Is anybody experiencing issues with release 1.7.0? Our cluster decided to die after it upgraded
    u
    • 2
    • 2
  • m
    Hi, how can I run Airbyte OSS over HTTP? Apparently the section is missing and using the flag 
    --insecure-cookies
    when installing with abctl doesn't work anymore... https://docs.airbyte.com/platform/using-airbyte/getting-started/oss-quickstart#running-over-http
    p
    i
    • 3
    • 5
  • a
    We are dropping Airbyte and moving to nifi
    c
    • 2
    • 1
  • a
    Please test the performance before adapting Airbyte. It wasted our efforts and impression to clients!!
    👎 2
  • i
    For those experiencing authentication issues with the Connector Builder in 1.7, please see the fix and details here: https://docs.airbyte.com/release_notes/v-1.7#171. There is some further discussion in GitHub about this. See https://github.com/airbytehq/airbyte/issues/61677#issuecomment-3046489964.
    j
    l
    • 3
    • 2
  • c
    Hello, currently working on AirByte Embedded setup. Are there any plans to support GCP destinations for embedded?
  • j
    Hello, Are there any plans to support postgresql 
    jsonb
    type ? It's actually parsed and loaded into S3 as 
    string
    type. We have more and more use case of providers and tables from our internal backend db using this type of field. We 're apparently not the only ones facing this challenge (https://airbytehq.slack.com/archives/C021JANJ6TY/p1713996557175259). Bests,
    💯 1
  • r
    I just tried to upgrade our Community Airbyte and ended up with the following disaster (fortunately I have snapshots!)
    Copy code
    INFO    Using Kubernetes provider:
            Provider: kind
            Kubeconfig: /root/.airbyte/abctl/abctl.kubeconfig
            Context: kind-airbyte-abctl
 SUCCESS  Found Docker installation: version 28.3.3
 SUCCESS  Existing cluster 'airbyte-abctl' found
 SUCCESS  Cluster 'airbyte-abctl' validation complete
 WARNING  Found MinIO physical volume. Consider migrating it to local storage (see project docs)
 WARNING  Psql 13 detected. Consider upgrading to 17
  INFO    Pulling image airbyte/connector-builder-server:1.8.1
  INFO    Pulling image airbyte/cron:1.8.1
  INFO    Pulling image airbyte/server:1.8.1
  INFO    Pulling image airbyte/worker:1.8.1
  INFO    Pulling image airbyte/workload-api-server:1.8.1
  INFO    Pulling image airbyte/workload-launcher:1.8.1
  INFO    Pulling image temporalio/auto-setup:1.27.2
  INFO    Namespace 'airbyte-abctl' already exists
  INFO    Persistent volume 'airbyte-minio-pv' already exists
  INFO    Persistent volume claim 'airbyte-minio-pv-claim-airbyte-minio-0' already exists
  INFO    Persistent volume 'airbyte-volume-db' already exists
  INFO    Persistent volume claim 'airbyte-volume-db-airbyte-db-0' already exists
  INFO    Starting Helm Chart installation of 'airbyte/airbyte' (version: 2.0.10)
  ERROR   Failed to install airbyte/airbyte Helm Chart
  ERROR   Unable to install Airbyte locally
  ERROR   unable to install airbyte chart: unable to install helm: cannot patch "airbyte-abctl-connector-builder-server" with kind Deployment: Deployment.apps "airbyte-abctl-connector-builder-server" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"airbyte":"connector-builder-server", "<http://app.kubernetes.io/instance|app.kubernetes.io/instance>":"airbyte-abctl", "<http://app.kubernetes.io/name|app.kubernetes.io/name>":"connector-builder-server"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable && cannot patch "airbyte-abctl-cron" with kind Deployment: Deployment.apps "airbyte-abctl-cron" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"airbyte":"cron", "<http://app.kubernetes.io/instance|app.kubernetes.io/instance>":"airbyte-abctl", "<http://app.kubernetes.io/name|app.kubernetes.io/name>":"cron"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable && failed to create patch: The order in patch list:...
    v
    • 2
    • 1
  • s
    Hi Guys I was trying to find the frontend code of Airbyte in the latest-release The documentation said that it should be inside a folder named web-app but there wasn't any Does anyone have an idea on where could we find this
    l
    t
    • 3
    • 2
  • u
    Hi everyone, I'd like to know about the progress of the Java CDK. I'm planning to update/develop a destination for a database. I noticed that Airbyte's destination development documentation mentions 'The template for building a Java Destination connector is currently unavailable. The Airbyte team is working on revamping the Java CDK.' and 'A new CDK destination v2 is planned for release in 2024.' This confuses me. Is there a stable and available Java CDK for developing destinations at this stage? Is this documentation still valid? https://docs.airbyte.com/platform/connector-development/tutorials/building-a-java-destination
  • p
    Just wondering how i can see the code for the latest 1.8 patches?
    a
    j
    • 3
    • 3
  • r
    i see that direct loading for Snowflake was shipped yesterday! https://docs.airbyte.com/integrations/destinations/snowflake#changelog but i haven't really seen announcements on it. is direct loading ready to use/try out?
    g
    • 2
    • 4
  • j
    Hey friends! Question, how to setup metrics in the OSS version? We were using OpenTelemetry, but it seems recent versions disabled that option for OSS users? Is that right?
    h
    l
    • 3
    • 2
  • a
    Copy code
    in OSS i am using "abctl local credentials" command but while using it the client-id and client-secret in calling <http://localhost:8006/api/public/v1/source> i am getting  401 unauthorized error why is that?
    j
    y
    s
    • 4
    • 22
  • q
    Hi team, I’m running into an issue after upgrading the BigQuery destination connector to 
    v3.0.x
    . I'm using a pipeline from 
    PostgreSQL → BigQuery
    , and now the sync is failing with this error:
    Copy code
    java.lang.ClassCastException: class io.airbyte.cdk.load.data.NullValue cannot be cast to class io.airbyte.cdk.load.data.TimestampWithoutTimezoneValue
(io.airbyte.cdk.load.data.NullValue and io.airbyte.cdk.load.data.TimestampWithoutTimezoneValue are in unnamed module of loader 'app')
    This wasn’t happening before — the sync worked fine when I were on a < 
    3.0.x
     version of the connector. Unfortunately, downgrading isn’t an option at the moment because v3.0.x no longer uses the 
    airbyte_internal
    dataset for temporary data storage, which we’ve already removed/configured around. Any ideas on how to work around this or if a patch is on the way?
  • j
    Hi all, I recently have this issue but I do not know why… Airbyte worked until here…?
    Copy code
    unable to initialize local command: error communicating with kubernetes: unable to fetch kubernetes server version: Get "<https://127.0.0.1:46427/version>": EOF - error from a previous attempt: read tcp 127.0.0.1:51296->127.0.0.1:46427: read: connection reset by peer