Hi Team, I'm looking for some inputs on datahub capabilities to extract and harvest the lineage from Avro nested schema. Airflow will be the orchestrator in this case and I'd like to understand will I be able to extract the table level, column level and computation level granularity from the extracted lineage to establish data observability and traceability ?

Hmm not really sure on this - @bulky-soccer-26729 could you look into this?

yeah good question hate to pass it along one more time but let me get our ingestion pal @famous-waitress-64616 in here

@victorious-gigabyte-26271 please, can you elaborate a bit more on what you want to achieve? It is not clear to me how Avro nested schema relates to lineage.