Hello everyone, maybe someone had such a case, but...
# advice-metadata-modelingr
refined-airline-32009
03/14/2022, 4:36 PMHello everyone, maybe someone had such a case, but still:
First, I want to visualize a complete line chart of the data, is it possible? Second, can datahub parse DAG internals, such as inline SQL queries, and include them in an lineage graph?
In which direction should I dig to find answers
I would be grateful even for a tip, thanks
g
green-football-43791
03/14/2022, 8:02 PMHey @refined-airline-32009 - what do you mean line chart of the data-- are you referring to a lineage chart of your data?
green-football-43791
03/14/2022, 8:02 PMAnd which tool are you using to author DAGs? Airflow?
r
refined-airline-32009
03/15/2022, 10:39 AMHi, @green-football-43791! Yes, i was mean data lineage chart, and yes, i'm using Airflow, as you mentioned
g
green-football-43791
03/15/2022, 2:57 PMThen yes, it is possible to view complete data lineage. However, you will have to expand the edges manually to get there as of today.
green-football-43791
03/15/2022, 2:57 PMRight now, we are not parsing DAG internals but we have a lot of exciting airflow improvements coming down the pipe!
green-football-43791
03/15/2022, 2:57 PMIncluding a better understanding of dag internals
r
refined-airline-32009
03/15/2022, 6:49 PMWow @green-football-43791, thank you very much!
What did you mean by speaking of improvements coming down the pipe? Some sort of new features or ... ?
2 Views