A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hello, I ran an ingestion and it picked up a database that we don't want to show with hundreds of tables. Is there a way that I can remove all the datasets in that database? (it's a snowflake database). Thank you

you could rollback the specific ingestion run, and rerun ingestion with a better whitelist
list runs first to get the id, `datahub ingest list-runs`
rollback: `datahub ingest rollback --run-id`

hmm the database has been there for weeks, so roughly 15 ingestions ago. I don't really wanna go back that far

is there a way to get all of the urns for a database and hit /entities?action=delete on all of them?

i can write. a python script to delete a set of records, im just not sure how to extract the urns i want

hmmm... there might be a more elegant way, but i guess you can search for snowflake datasets in search, filter by the "container", then export out all the listings using the export results button. the exported file has the urns you would need

the delete cli has a filter option but i have not used it before

<https://datahubproject.io/docs/how/delete-metadata/#delete-all-datasets-that-match-a-query>

i got a query that looks like this
```import requests, json
url = '<http://datahub-gms.metigy.com:8080/entities?action=search>'
body = {
    "input": "",
    "entity": "dataset",
    "container": "bi_staging",
    "env": "PROD",
    "start": 0,
    "count": 10,
    # "filter": {
    #     "criteria": [
    #        {
    #             "field": "title",
    #             "value": "Baz Chart 1",
    #             "condition": "EQUAL"
    #        }
    #     ]
    # }
}```
but container and env attribute makes no difference, is there an api doc how to use this endpoint, I can't find i

i have not really used this mode of query before..

i ended up just exporting all the urns and then deleting based on regex

hmmm if its just to query the list of urns, the graphql endpoint would also work rather than querying GMS. but probably too late for your use case :stuck_out_tongue: