Hello! I’ve done a

datahub delete --hard

for the dbt platform, however the homepage is displaying an incorrect dbt stats. Am I missing anything else? What else do I need to delete?

Hi @purple-printer-15193, have you reviewed the docs here? https://datahubproject.io/docs/how/delete-metadata. You may want to do a rollback instead

If im not mistaken, running datahub delete -p platform doesn't delete all the entities. I had an issue with containers being still much alive and having to explicitly delete the container entity type.

I’ve run a delete on

dataset

and

container

entity types but stats are still incorrect

root@datahub-acryl-datahub-actions-74cc565f9d-72m6x:/etc/datahub/actions# DATAHUB_GMS_TOKEN="***" datahub delete --entity_type dataset --platform dbt --hard
This will permanently delete data from DataHub. Do you want to continue? [y/N]: y
[2023-02-13 21:07:54,589] INFO     {datahub.cli.delete_cli:285} - datahub configured with <http://datahub-datahub-gms:8080>
[2023-02-13 21:07:54,618] INFO     {datahub.cli.delete_cli:321} - Filter matched  dataset entities of dbt. Sample: []
No urns to delete. Maybe you want to change entity_type=dataset or platform=dbt to be something different?
Took 2.316 seconds to hard delete 0 versioned rows and 0 timeseries aspect rows for 0 entities.

root@datahub-acryl-datahub-actions-74cc565f9d-72m6x:/etc/datahub/actions# DATAHUB_GMS_TOKEN="***" datahub delete --entity_type container --platform dbt --hard
This will permanently delete data from DataHub. Do you want to continue? [y/N]: y
[2023-02-13 21:08:06,453] INFO     {datahub.cli.delete_cli:285} - datahub configured with <http://datahub-datahub-gms:8080>
[2023-02-13 21:08:06,483] INFO     {datahub.cli.delete_cli:321} - Filter matched  container entities of dbt. Sample: []
No urns to delete. Maybe you want to change entity_type=container or platform=dbt to be something different?
Took 2.087 seconds to hard delete 0 versioned rows and 0 timeseries aspect rows for 0 entities.

Hi folks. Unfortunately this is a known problem with non-dataset entities in the delete CLI. We are internally triaging this to get the deletes back in business

Guess you can then keep on deleting entity types until all of them actually get removed? 🤔

Hey @big-carpet-38439, which pod is responsible for displaying the homepage stats? Could I do a delete on the database or something?

datahub-gms is responsible. one approach you can take to unblock is basically to call delete for a single URN after feching the container urns!