Hi all. How can I set lineage between dags, for ex...
# advice-metadata-modeling
p
Hi all. How can I set lineage between dags, for example if I use the TriggerDagOperator to call another dag, how do I create the lineage between dag A and B, and in case that is possible if there is a way to see airflow lineage at dag level or only task level is available. Probably a common question but I have failed to search here and on the documentation. Thank you.
1
g
Currently, it's not possible to see lineage at DataFlow Level. The Airflow Lineage Backend don't build lineage at DAG's level because DataFlow model don't have upstreams or downstreams dependencies. Only tasks (DataJob) have. It would be necessary to update datahub metadata model. DataFlow model: https://datahubproject.io/docs/generated/metamodel/entities/dataflow/ DataJob model: https://datahubproject.io/docs/generated/metamodel/entities/datajob/