polite-ghost-91039
11/03/2022, 10:47 AMmicroscopic-mechanic-13766
11/03/2022, 11:23 AMpolite-ghost-91039
11/03/2022, 11:27 AMmicroscopic-mechanic-13766
11/03/2022, 11:32 AMpip install acryl-datahub-airflow-plugin
I haven't tested myself the 0.9.1 version of the plugin but the version 0.8.45 works finepolite-ghost-91039
11/03/2022, 11:33 AMmicroscopic-mechanic-13766
11/03/2022, 11:39 AMAIRFLOW__LINEAGE__BACKEND: datahub_provider.lineage.datahub.DatahubLineageBackend
AIRFLOW__LINEAGE__DATAHUB_CONN_ID: 'datahub_rest_default'
AIRFLOW__LINEAGE__CAPTURE_OWNERSHIP_INFO: 'True'
AIRFLOW__LINEAGE__CAPTURE_TAGS_INFO: 'True'
AIRFLOW__LINEAGE__GRACEFUL_EXCEPTIONS: 'True'
AIRFLOW__LINEAGE__DATAHUB_KWARGS: '{"capture_executions": true}'
Note that these properties are not the exactly the same as the ones you would have to writte in the airflow.cfg file, they would have to be without "AIRFLOW__LINEAGE__" if I am not mistakenpolite-ghost-91039
11/03/2022, 11:41 AMmicroscopic-mechanic-13766
11/03/2022, 11:46 AMpolite-ghost-91039
11/03/2022, 11:48 AMflat-painter-78331
04/28/2023, 5:44 AM