A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Can someone point me to the DAG of <https://demo.datahubproject.io/tasks/urn:li:dataJob:(urn:li:dataFlow:(airflow,orders_load,PROD),orders_etl_job1)?is_lineage_mode=true|this> airflow task on the demo site.

Based on the urn `urn:li:dataJob:(urn:li:dataFlow:(airflow,orders_load,PROD),orders_etl_job1)` the flow name should be `urn:li:dataFlow:(airflow,orders_load,PROD)`  -&gt; <https://demo.datahubproject.io/pipelines/urn:li:dataFlow:(airflow,orders_load,PROD)/Documentation?is_lineage_mode=false>

you can also click on the "Details" button in the upper right corner, and the go to the Pipeline tab

Yes but i can not see the source code of the DAG.
View in airflow button takes me to the airflow website instead.
Do we have the source code of <https://demo.datahubproject.io/pipelines/urn:li:dataFlow:(airflow,orders_load,PROD)/Documentation?is_lineage_mode=false|this> DAG/Pipeline.

<@U02255U7NR3> It seems that particular DAG is from an older deployment. The source is not in the hosted airflow for now.  But you can find other DAGs here <https://airflow.demo.datahubproject.io/home>

e.g. you can find code for one such DAG here <https://airflow.demo.datahubproject.io/code?dag_id=datahub_analytics_refresh>

Was there anything specific that you were trying to figure out from the DAG code <@U02255U7NR3>?

<@U027B7R23J4> Thanks for sharing the code. I was looking for how to define Data_Job entity in DAG and how many other entities are available apart from the dataset entity.

<https://demo.datahubproject.io/tasks/urn:li:dataJob:(urn:li:dataFlow:(airflow,orders_load,PROD),orders_etl_job1)?is_lineage_mode=true|Data_Job Entity>

The metadata related to Airflow jobs in datahub comes through lineage configured in airflow <https://datahubproject.io/docs/lineage/airflow>
We have some examples if you are trying to do it through code <https://datahubproject.io/docs/lineage/sample_code>

okay thanks.
Le me try this <https://github.com/linkedin/datahub/blob/master/metadata-ingestion/examples/library/lineage_dataset_job_dataset.py#L22>