Hi @channel, This is my first time using Airbyte. ...
# troubleshooting
b
Hi @channel, This is my first time using Airbyte. I've come across this particular use case where I have to use Airbyte for Batch load from snowflake to Google cloud storage. So I'm able to establish the source as Snowflake and Destination as BigQuery but not Destination as GCS. The file size on an Average is approximately over 1GB. Are there any limitations as to file size which Airbyte can support while loading it to GCS from Snowflake?
a
Hi @Brian Soares I don't really get if you encountered an error or not. Do you run into a problem during the replication of Snowflake to GCS?
The file size on an Average is approximately over 1GB
Which file are you mentionning? The upload to GCS is using multipart upload so the maximum size of a part is defined according to your configuration.
b
The Error I'm facing is that while creating a connection between source (Snowflake) and destination (BigQuery), it's not able to fetch schema from the source. It constantly crashed giving out the error message as "Failed to fetch schema from source" @Augustin Lafanechere (Airbyte)
The files are displayed once the connection between source and destination is established. The connection itself is not working so that's where I'm currently stuck
m
@Brian Soares please share logs or a print screen of errors you’re seeing, so far is not clear.