i'm using the quick-start with a custom MCE that i...
# getting-startedb
better-orange-49102
05/05/2021, 2:15 AMi'm using the quick-start with a custom MCE that i wrote.
for me to delete a dataset that i've ingested via the rest api, is there any better/easier way to do so other than to:
1. go into mysql and delete record
2. go into ES container and delete document
3. go into neo4j container and delete data
is there any other container that i missed out?
a
average-magician-35209
05/05/2021, 3:20 AMCareful. This will delete all your data.
https://datahubproject.io/docs/debugging/#ive-messed-up-my-docker-setup-how-do-i-start-from-scratch
./docker/nuke.shb
better-orange-49102
05/05/2021, 3:21 AMand all the running containers as well, yeah.
💯 1
e
early-lamp-41924
05/05/2021, 3:54 AMCurrently, to actually delete a record from the system. You have to follow the above process. You can also ingest a Status aspect for the entity you are trying to remove and set removed to true. Described https://github.com/linkedin/datahub/blob/master/metadata-models/src/main/pegasus/com/linkedin/common/Status.pdl
early-lamp-41924
05/05/2021, 5:41 AMAlso check the documentation here! https://datahubproject.io/docs/what/entity/#how-to-delete-an-entity
✅ 1
b
better-orange-49102
05/05/2021, 5:42 AMthanks Dexter!
m
mammoth-bear-12532
05/06/2021, 4:19 PM
Seems like a nice opportunity for improving user experience through the
datahubdatahub metadata remove urn:li:dataset:foo👍 3
f
full-area-6720
11/30/2021, 7:15 AM@better-orange-49102 how does one use quickstart with custom MCE?
b
better-orange-49102
11/30/2021, 7:16 AMthe quickstart just starts up datahub. you can ingest using file to datahub-rest recipe
better-orange-49102
11/30/2021, 7:16 AMcan just modify the sample bootstrap_mce.json in examples folder
f
full-area-6720
11/30/2021, 7:44 AMOk @better-orange-49102, thanks for responding so quick! I thought this was related to mysql. I am trying to use our own mysql db for backing up in docker. Is that possible in quickstart?
b
better-orange-49102
11/30/2021, 7:48 AMyou mean you want to connect your own mysql instance instead of starting up a new instance of mysql container in quickstart? if so you cant use quickstart because it is not customisable: https://datahubspace.slack.com/archives/C029A3M079U/p1635469422117000?thread_ts=1635451263.110700&cid=C029A3M079U
e
early-lamp-41924
11/30/2021, 7:55 AMNote that you could go ahead and update the yaml file used by quickstart https://github.com/linkedin/datahub/blob/master/docker/quickstart/docker-compose-without-neo4j.quickstart.yml#L49 (all local db related configs are on datahub-gms env) and use the following command to use your local yaml for deploy
Copy code
datahub docker quickstart --quickstart-compose-file <<path-to-above-file>>early-lamp-41924
11/30/2021, 7:56 AMnote that this will use your mysql as the main db (not just backup)
f
full-area-6720
11/30/2021, 8:01 AMThanks you @better-orange-49102 @early-lamp-41924 I will try this
2 Views