Looks like it's not a bug, this is an intended fea...
# ask-community-for-troubleshooting
m
Looks like it's not a bug, this is an intended feature? How do we sync views and CDC together? https://github.com/airbytehq/airbyte/pull/14447
m
@Liren Tu (Airbyte) do you mind explaining the reason why views aren’t sync using CDC?
m
The issue is views no longer show up as options to sync anymore. @Marcos Marx (Airbyte)
l
do you mind explaining the reason why views aren’t sync using CDC?
CDC reads from write-ahead-logs (for Postgres) or binlogs (for MySQL). Only the physical tables have those logs. Changes to views are not included in the logs. So there is no way for CDC to get them.
m
The issue isn't the views not syncing with CDC, they were being synced with truncate and reload. The issue is they no longer appear in the interface to be synced. I now can't sync views from my Postgres source.
The workaround for this would be to set up two sources for the same Postgres source. One to sync tables via CDC and the other to sync views. That's not ideal since we have micro services and many Postgres databases
l
Right, currently we don’t support reading table through CDC and views at the same time. So setting up two syncs to separate them is the only workaround for now. Can you create an issue if this is a feature you’d like to have?
m
You did support this though for well over a year. The change I posted above broke this. I can't imagine this was intended as it's limiting?
l
This was intended. We were trying to optimize the CDC mode in various ways at that time. I have created this issue to track it: https://github.com/airbytehq/airbyte/issues/16761
m
Thank you!
l
Actually I cannot remember what’s the benefit of doing pure CDC in one sync. So this could be a regression. I’ve updated the issue description to include that.
👍 1