When I proceed with ingestion on Datahub Web UI, the new meta data seems to be uploaded well. But does it not support the function for deletion? For example, there are (a1, a2, a3) in the dataset ‘A’. If ‘a2’ is deleted and ‘a4’ is newly created, the expected result of ‘A’ after ingestion is (a1, a3, a4). However, the results (a1, a2, a3, a4) are derived. How can I perform the function for deletion?

Hey!! So you need to enable stateful ingestion to get this functionality. Basically we need to know that the dataset got deleted bc we don’t know what is the full set of datasets that was ingested by a similar connector in the past. Please refer to this doc for more details! https://datahubproject.io/docs/metadata-ingestion/source_docs/stateful_ingestion/ Should be a simple flag in the recipe