Hello, I have a couple questions. Overall been ve...
# ask-community-for-troubleshooting
z
Hello, I have a couple questions. Overall been very pleased with the experience with Airbyte. However, I'm testing setting up various connections and am a bit confused. As we are frequently adding and modifying tables in our source Postgres application database and need to sync them to Snowflake, we'll constantly be updating the connections. When I select the 'Update to latest schema' button it is telling me it's going to reset ALL of my data and start all over... Some of our tables are hundreds of GBs, so this will take days. The source schema for most tables hasn't changed.. I'm just looking to add an additional table. In this case is it recommended to create a connection per table? In that case is there a way to 'name' a connection so we're not looking at a list of 75+ connections all with the same exact information (source / dest) shown on the page? Thanks for the help!
โœ… 1
u
Hello Zack ๐Ÿ‘‹ , there is an issue to implement the concept of schema evolution https://github.com/airbytehq/airbyte/issues/6912 in the future you donโ€™t need to reset your data. At the moment, people try to create a connection for small tables and specific connections for large tables.
z
Hey Marcos, Appreciate the quick response! I'll watch that issue and experiment with your suggestion. As another work around is it possible to manually make the updates to the exported configuration and reimport it? (knowing i might break things ๐Ÿ˜„ )
Thinking I could modify the STANDARD_SYNC.yaml file and add/edit the
streams
in there?