Would Airbyte be seen as a 1:1 replacement for Snowpipe (Snowflakes ingestion from S3)?
Augustin Lafanechere (Airbyte)
01/31/2022, 8:23 PM
Hi @Dave Lindley I'm not aware of the details of Snowpipe, but Airbyte indeed allows you to load and normalize data stored on S3
01/31/2022, 10:32 PM
Thanks - I’m looking specifically into CDC for S3->Snowflake. Currently snowpipe is just ‘write whatever lands in S3 to snowflake’ and looking for more ‘keep snowflake in sync with lake via CDC’ functionality, but I think maybe that falls more into the deltalake/hudi area than the ETL tools area? idk
02/01/2022, 4:51 AM
Hey do you mind creating an issue around it if it makes sense to have that feature,