Hey everyone, I've been struggling with a CDC issu...
# replication-troubleshooting
p
Hey everyone, I've been struggling with a CDC issue. Error:
Saved offset is before replication slot's confirmed lsn. Please reset the connection, and then increase WAL retention and/or increase sync frequency to prevent this from happening in the future.
Connector:`source-postgres:3.6.35` Setup: Self-hosted Airbyte on Kubernetes → RDS PostgreSQL (CDC via pgoutput) → S3 We have already tried: - Increasing WAL retention to 10 GB. Our peak data volume between syncs is only ~3 GB, so WAL exhaustion was never the real cause - Increased sync frequency to every 1 hour. Didn't help - Set
invalid_cdc_cursor_position_behavior
to
Re-sync data
— this silently masked the error by triggering full refreshes on every failure I am aware that this is a common error among the community. Has anyone manage to find a proper solution? 🙏
m
this was fixed in source-postgres 3.7.2
❤️ 1