<@U04S8PLJWMT> any commits regarding faster cdc sy...
# replication-ask-ai
a
@kapa.ai any commits regarding faster cdc syncs using protobuff with new cdk coming with airbyte 2.2?
k
The knowledge sources don't contain specific information about Airbyte 2.2 or a dedicated release tied to that version. However, there are several recent commits/PRs in the knowledge sources related to faster CDC syncs using PROTOBUF with the Bulk CDK that are relevant: Recent CDC + PROTOBUF Improvements 1. Fix: CDC decoration for no-PK full-refresh streams in protobuf mode [Bulk CDK fix] In
FeedBootstrap.kt
, a guard was added so that CDC metadata fields (
_ab_cdc_lsn
,
_ab_cdc_updated_at
,
_ab_cdc_deleted_at
) are not incorrectly added to full-refresh streams without primary keys in PROTOBUF mode. This prevented positional field misalignment at the destination. 2. Fix: source-mysql CDC protobuf alignment for views without PKs [source-mysql fix] A runtime guard was added so that no-PK full-refresh stream records use non-decorated
recordFields
, keeping protobuf positions aligned with the catalog schema. 3. Test coverage for speed mode (SOCKET + PROTOBUF) decoration logic [StateManager tests] Added 7 test cases specifically validating the meta field decoration behavior for full-refresh streams in global (CDC) syncs under SOCKET/PROTOBUF speed mode. 4. destination-gcs migrated to Bulk Load CDK [GCS migration] GCS now advertises
connectorIPCOptions
(SOCKET/PROTOBUF with STDIO/JSONL fallback), bringing it onto the maintained high-throughput stack. 5. destination-mssql: speed mode enabled [MSSQL speed mode] Added
connectorIPCOptions
to enable SOCKET/PROTOBUF IPC transport for MSSQL destination. 6. OOM fix for large CDC events (MongoDB/Postgres/MySQL/MSSQL) [Debezium queue fix] The Debezium event queue is now bounded by byte size (25% of JVM max heap) in addition to element count, preventing OOM errors with large CDC change events (~833KB) in CDC syncs. The knowledge sources do not explicitly confirm which of these will ship as part of an "Airbyte 2.2" release. For the most accurate release mapping, I'd recommend checking the Airbyte release notes directly. 👍 0 button 👎 0 button â„šī¸ Tip: Mention @kapa.ai in the thread for follow-ups or DM the app for 1-to-1 help.