Hi Team, We are facing this error when installing Datahub packages in Airflow instances :

File "/root/.venvs/airflow/lib/python3.7/site-packages/airflow/lineage/__init__.py", line 103, in apply_lineage
    _backend = get_backend()
  File "/root/.venvs/airflow/lib/python3.7/site-packages/airflow/lineage/__init__.py", line 52, in get_backend
    clazz = conf.getimport("lineage", "backend", fallback=None)
  File "/root/.venvs/airflow/lib/python3.7/site-packages/airflow/configuration.py", line 675, in getimport
    f'The object could not be loaded. Please check "{key}" key in "{section}" section. '
airflow.exceptions.AirflowConfigException: The object could not be loaded. Please check "backend" key in "lineage" section. Current value: "datahub_provider.lineage.datahub.DatahubLineageBackend".

We are using the following configurations :

[lineage]
backend = datahub_provider.lineage.datahub.DatahubLineageBackend
datahub_kwargs = {
    "enabled": true,
    "datahub_conn_id": "datahub_rest_default",
    "cluster": "prod",
    "capture_ownership_info": true,
    "capture_tags_info": true,
    "graceful_exceptions": true }

Hey @handsome-football-66174, It's a depricated way of using datahub. See the docs here: https://datahubproject.io/docs/lineage/airflow/#using-datahubs-airflow-lineage-backend-deprecated Please use the plugin: https://datahubproject.io/docs/lineage/airflow/#using-datahubs-airflow-lineage-plugin

@bulky-electrician-72362 - Thank you for sharing the info ! with the latest changes I dont see where to configure to set capture executions in Airflow to true Do we directly add these configurations to airflow.cfg ? https://datahubproject.io/docs/lineage/airflow/#setup ( step 4 )