gray-ocean-32209
01/27/2023, 1:27 PM[lineage]
backend = datahub_provider.lineage.datahub.DatahubLineageBackend
datahub_kwargs = {
"datahub_conn_id": "datahub_rest_default",
"cluster": "local_airflow",
"capture_ownership_info": true,
"capture_tags_info": true,
"capture_executions": true,
"graceful_exceptions": true }
To see the information about the runs history of airflow tasks in datahub added "capture_executions": true
whenever we add this option `"capture_executions": true``
and try to initialize airflow with cmd docker-compose up airflow-init it fails with
....
datahub-airflow-airflow-init-1 | _backend = get_backend()
datahub-airflow-airflow-init-1 | File "/home/airflow/.local/lib/python3.9/site-packages/airflow/lineage/__init__.py", line 61, in get_backend
datahub-airflow-airflow-init-1 | return clazz()
datahub-airflow-airflow-init-1 | File "/home/airflow/.local/lib/python3.9/site-packages/datahub_provider/lineage/datahub.py", line 64, in __init__
datahub-airflow-airflow-init-1 | _ = get_lineage_config()
datahub-airflow-airflow-init-1 | File "/home/airflow/.local/lib/python3.9/site-packages/datahub_provider/lineage/datahub.py", line 35, in get_lineage_config
datahub-airflow-airflow-init-1 | return DatahubLineageConfig.parse_obj(kwargs)
datahub-airflow-airflow-init-1 | File "pydantic/main.py", line 511, in pydantic.main.BaseModel.parse_obj
datahub-airflow-airflow-init-1 | File "pydantic/main.py", line 331, in pydantic.main.BaseModel.__init__
datahub-airflow-airflow-init-1 | pydantic.error_wrappers.ValidationError: 1 validation error for DatahubLineageConfig
datahub-airflow-airflow-init-1 | capture_executions
I’m running acryldata/airflow-datahub:latest image
is ’`capture_executions`, is not supported?big-carpet-38439
02/13/2023, 9:58 PM