https://linen.dev logo
d

Dave Lindley

01/31/2022, 5:18 PM
Would Airbyte be seen as a 1:1 replacement for Snowpipe (Snowflakes ingestion from S3)?
👀 2
🔥 1
a

Augustin Lafanechere (Airbyte)

01/31/2022, 8:23 PM
Hi @Dave Lindley I'm not aware of the details of Snowpipe, but Airbyte indeed allows you to load and normalize data stored on S3
d

Dave Lindley

01/31/2022, 10:32 PM
Thanks - I’m looking specifically into CDC for S3->Snowflake. Currently snowpipe is just ‘write whatever lands in S3 to snowflake’ and looking for more ‘keep snowflake in sync with lake via CDC’ functionality, but I think maybe that falls more into the deltalake/hudi area than the ETL tools area? idk
h

Harshith (Airbyte)

02/01/2022, 4:51 AM
Hey do you mind creating an issue around it if it makes sense to have that feature,
4 Views