Hi everyone! Testing out Airbyte (awesome work!) a...
# advice-data-ingestion
j
Hi everyone! Testing out Airbyte (awesome work!) and running into an issue ingesting data from Redshift. It looks like the connection is getting closed and the sync then hangs in the running state. It appears to do be doing this at around 37 million records, or could also be a timeout setting. Anyone have any ideas on how to handle this? Trying to load billions in so I imagine there’s going to be lots of connection problems during the initial load. Would be great to be able to handle these and pick up where it left off.
Copy code
2022-04-08 02:16:20 source > 2022-04-08 02:16:20 ERROR i.a.c.u.CompositeIterator(close):93 - exception while closing
2022-04-08 02:16:20 source > java.lang.RuntimeException: java.sql.SQLException: [Amazon](500150) Error setting/closing connection: Not Connected.
m
Hey there, this channel is to discuss #advice-data-ingestion, if you’re having issues with Airbyte we recommend posting in Discourse to receive support.
👍 1