Is this your first time deploying Airbyte: Yes OS Version / Instance: Amazon Linux Memory / Disk: 8 GB Deployment: Docker Airbyte Version: 0.35.46-alpha Source name/version: MSSQL 0.3.17 Destination name/version: Snowflake 0.4.20 Description: 2022-03-15 011306 ERROR i.a.w.DefaultReplicationWorker(run):168 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1 • Can some one please help me with the internal staging connection with snowflake is there any script which I am suppose to run and missing out. I have also given ownership and usage for all future stages to the role AIRBYTE_ROLE but it stills fails.

loading...

Hey was our documentation helpful https://docs.airbyte.com/integrations/destinations/snowflake?

@Harshith (Airbyte) I am still stuck with the issue and as per the documentation I have already given access to Table and Schema to the Airbyte role I am using but still the same error and not loading any data in my snowflake tables. It is creating stage and tmp and raw table along with the permanent table but not emitting any data inside it

@Aditya Rane are you using GCS or S3 staging method? Or is it the internal Snowflake? If it’s the former please follow docs how to setup it: https://docs.snowflake.com/en/sql-reference/sql/create-stage.html

@Marcos Marx (Airbyte) I am using internal staging method as Airbyte creates its own stage in snowflake and I just gave the usage privilege on the parent database and schema for the role I created but it was failing. I also used the S3 bucket for staging where it creates 4 small files in S3 and only takes the latest file and upload it to snowflake. Should I use external staging in snowflake something like this:

create stage my_ext_stage1
  url='<s3://load/files/>'
  credentials=(aws_key_id='1a2b3c' aws_secret_key='4x5y6z');

Will this work?

I also used the S3 bucket for staging where it creates 4 small files in S3 and only takes the latest file and upload it to snowflake. Should I use external staging in snowflake something like this:

so it’s “working” data are landing in Snowflake? The problem now it’s only loading data from one file from s3? similar to: https://github.com/airbytehq/airbyte/issues/11052

@Marcos Marx (Airbyte) correct

Team is working in a solution