Marcos Marx (Airbyte)
05/09/2024, 3:13 PM_airbyte_meta.errrors
. Read more in our typing & deduping documentation.
• THIS ONE IS HUGGGGEEEE We’ve also improved our schema discovery to ensure you can sync more data within a single connection. The new environment variable MAX_FIELDS_PER_CONNECTION
controls the maximum allowable fields per connection per deployment and can be configured at runtime. By default, the platform defaults to 20,000 fields across enabled streams. When using Airbyte Cloud, our Technical Support team can assist with modifying your configuration.
• Reduced friction for large records. Airbyte’s platform no longer limits how large a record from the source can be. Instead, each destination has their own unique limit constraints. When a destination receives a large record, the primary key and cursor will be retained, but all other data in the record will be nulled. Any modifications to the record will be stored within airbyte_meta.changes
for your review within the destination.
Please see the following updates on the page => Release Notes April 2024
Another notable change is the deprecation of Custom dbt Transformations in version 0.57.0 (you can find more details in this discussion)