I have existing connection on airbyte that sync da...
# ask-community-for-troubleshooting
q
I have existing connection on airbyte that sync data from Postgres to Bigquery at intervals of 30min using deduped/Incremental sync mode. Everything had been working for all these days, however I just noticed that few of synchronization today, is doing full refresh, in spite of the fact all tables are set for deduped /Incremental mode. Please, appreciate any insights on where to look for resolution. Thanks
a
WAL logs may be getting cleared by the time source tries to find the position it can restart the sync from. You may see what is happening in the sync logs.
q
Thanks, I figured it out, another team member setup another airbyte connection to same data source, using same pg_slot, publication albeit with a minutes sync intervals. Temporarily solution was to paused the recent airbyte connection.