Hi all, BigQuery lineage question. Say we have this flow of tables and views: TABLE_A --> VIEW_A --> VIEW_B VIEW_B is based on VIEW_A which in turn is built on top of TABLE_A. I've tried to run an ingestion with a lineage from BigQuery exported audit logs and it returned a graph like: TABLE_A --> VIEW_A ┕--> VIEW_B Is there a way to build a lineage more in a "chained" way to be able to track the order of views built on top of each other?

We are looking to improve our bigquery lineage connector currently. I will take a look. We should have an update probably by next week on this unless something more urgent comes up

Thanks! Fingers crossed 🙂 Slightly unrelated note: if an update is planned, it might be beneficial to investigate this GitHub issue as it's also related to exported audit logs. Just giving a heads-up.

Thanks for letting me know. Will look at it during bugfixes for bigquery

@square-activity-64562 thank you for coming back. I will try to test it without using exported audit metadata tables (somehow using audit logs directly were returning 0 entries for my BQs). Otherwise I will just wait till the issue about exported audit tables is fixed.

I was able to reproduce https://github.com/datahub-project/datahub/issues/4529 locally. I am working on a fix

@square-activity-64562 confirmed, thank you