Join Slack
Powered by
Hey team, i am not able to ingest airflow metadata...
# ingestion
l
limited-forest-73733
05/18/2023, 11:01 AM
Hey team, i am not able to ingest airflow metadata to datahub via datahub_kafka_default, its not throwing any error to me even if give wrong bootstrap url, My config file and log file:
g
gentle-hamburger-31302
05/24/2023, 8:09 AM
Hi
@limited-forest-73733
Did you register the source as per step 3 in doc:
https://datahubproject.io/docs/lineage/airflow#setup
l
limited-forest-73733
05/24/2023, 9:03 AM
Yeah there is an issue in kafka sink, we are not calling flush method. I can see having open PR to fix it
g
gentle-hamburger-31302
05/30/2023, 5:30 AM
Hi
@limited-forest-73733
Which PR are you referring to ? I haven't find any sink PR at DataHub github
l
limited-forest-73733
05/31/2023, 1:19 PM
It has been merged
3
Views
Open in Slack
Previous
Next