On the topic of lineage, our workloads are mostly Snowflake to Snowflake. Use cases being CTAS and merges. These are orchestrated by non-airflow tools including a custom designed one. For such cases, I think the preferred way to capture lineage is via the REST API (https://github.com/linkedin/datahub/blob/master/metadata-ingestion/examples/library/lineage_emitter_rest.py)? Is there a way for metadata-ingestion framework to parse SQL queries and pick table - table lineage? Thanks!

@brave-market-65632 for now, please use the emitter. We are actively collaborating with Snowflake for this use-case - stay tuned. Please also DM me if you want to be an early adopter.