Hello! I have a bunch of connections set up using...
# ask-community-for-troubleshootingm
Mark McKelvey
07/05/2022, 7:14 PMHello! I have a bunch of connections set up using AirByte Open Source. For the most part it works like a charm, however when I update the schema from the source (in this case Salesforce) or make any changes to the connection between Salesforce and BigQuery, the data no longer loads into the destination table though I see it in the _airbyte_raw_ tables. What am I doing wrong?
Mark McKelvey
07/05/2022, 7:17 PMMy solution has been to create a new connection which works well enough but it seems like I should be able to edit connections without breaking them.
a
Alex Marquardt (Airbyte)
07/05/2022, 7:17 PMAre you doing incremental updates?
From : https://docs.airbyte.com/understanding-airbyte/connections/incremental-append
“The current behavior of Incremental is not able to handle source schema changes yet, for example, when a column is added, renamed or deleted from an existing table etc. It is recommended to trigger a Full refresh - Overwrite to correctly replicate the data to the destination with the new schema changes.”
m
Mark McKelvey
07/05/2022, 7:19 PMYes, I have tested Full Refresh - Overwrite with the same result. Strangely, I don't see any error in the logs,
a
Alex Marquardt (Airbyte)
07/05/2022, 7:23 PMhttps://github.com/airbytehq/airbyte/issues/1967 looks related
m
Mark McKelvey
07/05/2022, 8:49 PMSomewhat, I will search open issues and if I can't find one that matches what I see I'll look to open a new one.