Hi Everyone, I’ve just started testing airbyte and...
# ask-community-for-troubleshooting
b
Hi Everyone, I’ve just started testing airbyte and, while going through the logs of a sync, I noticed that it lists all of the fields in my PostgreSQL tables (source) even for those tables that are not selected for sync. At first I thought this was to try and find out of any schema changes but it seems like schema changes are not detected so, I’m just curious, why are all of the fields and data types listed in the log? What is airbyte doing with every sync?
1
u
Hi @Bruno Lopes, we do not support schema change and field selection yet, so Airbyte is syncing all the columns found in a table. Does it answer your question?
b
Hi @[DEPRECATED] Augustin Lafanechere thanks for your help. can I just clarify what do you mean by “syncing all the columns”? is it the equivalent of clicking on the “Update latest source schema” button in the connection settings?
u
No, I just meant that you could not select which column is replicated as Airbyte replicates all the columns. If you click on update latest source schema, you will get the new tables/columns on your source, but the next sync will perform a full refresh, and previous replications will be lost.
b
“previous replications will be lost” so is that the same as the “reset your data” button?
👍 1
thanks @[DEPRECATED] Augustin Lafanechere!