hello :wave: the <source-postgres> connector suff...
# help-connector-development
k
hello šŸ‘‹ the source-postgres connector suffers from lots of bugs since
3.8.x
2 months old release, examples: • github.com/airbytehq/airbyte/issues/80939 • github.com/airbytehq/airbyte/issues/80295 • github.com/airbytehq/airbyte/issues/81431 • github.com/airbytehq/airbyte/issues/81397 • github.com/airbytehq/airbyte/issues/47547 • github.com/airbytehq/airbyte/issues/79109 šŸ‘‰ do you have any visibility regarding a solid fix ? āš ļø this is blocking for this šŸŽļø speeded up destination v2 adoption as
Change Data Capture
is unusuable šŸ˜• thank you!
šŸ‘€ 1
āž• 1
j
@Richelle Herrli First off, welcome and glad to have you in the mix! To Kevin's point, there's been a lot of chatter about these Postgres issues in various forms, and since this connector is widely used it may make sense to prioritize any related PRs (as part of the work you mentioned in this thread). (I know some of those conversations are off in internal tickets that the community doesn't have visibility into, but maybe there are some wins to be had there.)
šŸ™ 1
šŸ”„ 1
r
Thanks for tagging me, Justin! I'm checking internally about this connector and I'll let you know when I have intel.
šŸ”„ 1
@Kevin Lefevre is this one still relevant? It's from 2024 and I'm wondering if the issue has gone stale or if you're still encountering it. github.com/airbytehq/airbyte/issues/47547
k
hi @Richelle Herrli šŸ‘‹ welcome on board and thank you for considering this topic ! I do confirm, CDC is properly working on our side using PostgreSQL connector
v3.7.2
with heartbeat query šŸ‘
r
The Postgres version on Issue 47547 is 3.6.22. Is it not an issue on 3.7.2 but you're seeing a regression on 3.8? To better help you, I need to know which specific issues are impacting 3.8.
k
at least all listed in my first message except github.com/airbytehq/airbyte/issues/47547
(NB: all concerned issues refer to >=3.8 version)
r
Got it. I'll let you know if I have any news.
šŸ™ 1
k
Hi @Richelle Herrli šŸ‘‹ Please do you have visibility regarding CDC and XMin fixes in order to benefit from speed mode ? Thank you !
the rest are still in queue
šŸ‘ 1
k
ok thank you šŸ¤ž
Hi @Richelle Herrli, hope you're fine! Please do you have visibility regarding an ETA for all above issues ? Also, are you the right person who could help regarding those ones ? Thank you a lot, and at your disposal šŸ™‚
r
I don't currently have updates for Postgres, but I did pass along the PRs that are blockers for your team
šŸ™ 1
k
Hi @Richelle Herrli, any visibility now ? We would like to upgrade to speed mode in the weeks to come šŸ™
r
Hey Kevin, did you see github.com/airbytehq/airbyte/pull/82782? It fixes issues with CDC.
šŸ‘€ 1
šŸ™ 1
k
Hey @Richelle Herrli, thank you for follow up, really appreciated šŸ™‚ Looks like below issues must still be addressed to serenely upgrade to `v3.8`: • github.com/airbytehq/airbyte/issues/80939 • github.com/airbytehq/airbyte/issues/81431 • github.com/airbytehq/airbyte/issues/81397 • github.com/airbytehq/airbyte/issues/82266 and possibly with CDK upgrade: github.com/airbytehq/airbyte/pull/84996
r
@Kevin Lefevre I don't see any other updates but I'll check with the team. Are you updating your method from Xmin to CDC? Otherwise, I don't see how github.com/airbytehq/airbyte/issues/81397 is relevant to your use case.
šŸ™ 1
k
@Richelle Herrli ok thank you šŸ¤ž we currently have both XMin and CDC collects and our target is to fully move to CDC
I also created a new issue (not directly related to CDC but impacting it) for your information : https://github.com/airbytehq/airbyte/issues/85295 (already present in v3.7)
r
Letting folks know. Thanks Kevin!
šŸ™ 1
@Kevin Lefevre for the Debezium issue, we unfortunately need to wait for a fix from Debezium.
āœ… 1
k
@Richelle Herrli sure, it is not a blocker compared to other issues
Hi @Richelle Herrli, hope you're fine šŸ‘‹ Any news to share on PSQL connector topics ? šŸ™