Hi everyone, can datahub delete metadata while ingesting? The situation is I have datahub installed with ingested hive source. When I dropped a table in hive and ingested again, the dropped dataset was still in datahub. So must I call rest Api to delete the dataset in datahub? Is there an automatical way?

Currently there is no automated mechanism for it. So you need to delete the outdated datasets by yourself. But it’s already on the roadmap for Q4 😉

Ok, Thank you very much. Expecting!

Hi @bland-orange-95847, we have a use case for this as well. Can I check if hive table deletion is still in DataHub Q4 roadmap? 🙇 I didn’t see from here https://github.com/linkedin/datahub/blob/master/docs/roadmap.md

I think it is still on the roadmap. it was shown in the september or october town hall. @little-megabyte-1074 do you have more details or an updated roadmap for us? 🙂

Hey @bland-orange-95847, great to hear! Are you referring to the

Stateful Ingestion

from Sep townhall? I don’t see it related since there’s no timestamp info for hive metastore extraction 🤔