Hi,
we have a issue when we remove task in airflow dags
the task is still show in datahub how can i handle this case?
d
dazzling-judge-80093
12/02/2022, 2:19 PM
Yes, unfortunately as we can’t be sure this can be removed (as it can come from anywhere) we can’t remove it.
We are thinking a good way to handle this in the future.
g
gifted-knife-16120
12/03/2022, 4:59 PM
@dazzling-judge-80093 just to confirm, is this not happened only to the Airflow source rite? If I can recall, when I ingest Postgres data and for some reason tomorrow, I delete the table. And it still appears in Datahub.