b

    better-orange-49102

    1 year ago
    i'm using the quick-start with a custom MCE that i wrote. for me to delete a dataset that i've ingested via the rest api, is there any better/easier way to do so other than to:1. go into mysql and delete record 2. go into ES container and delete document 3. go into neo4j container and delete data is there any other container that i missed out?
    a

    average-magician-35209

    1 year ago
    b

    better-orange-49102

    1 year ago
    and all the running containers as well, yeah.
    e

    early-lamp-41924

    1 year ago
    Currently, to actually delete a record from the system. You have to follow the above process. You can also ingest a Status aspect for the entity you are trying to remove and set removed to true. Described https://github.com/linkedin/datahub/blob/master/metadata-models/src/main/pegasus/com/linkedin/common/Status.pdl
    b

    better-orange-49102

    1 year ago
    thanks Dexter!
    m

    mammoth-bear-12532

    1 year ago
    Seems like a nice opportunity for improving user experience through the
    datahub
    cli ...
    datahub metadata remove urn:li:dataset:foo
    f

    full-area-6720

    9 months ago
    @better-orange-49102 how does one use quickstart with custom MCE?
    b

    better-orange-49102

    9 months ago
    the quickstart just starts up datahub. you can ingest using file to datahub-rest recipe
    can just modify the sample bootstrap_mce.json in examples folder
    f

    full-area-6720

    9 months ago
    Ok @better-orange-49102, thanks for responding so quick! I thought this was related to mysql. I am trying to use our own mysql db for backing up in docker. Is that possible in quickstart?
    b

    better-orange-49102

    9 months ago
    you mean you want to connect your own mysql instance instead of starting up a new instance of mysql container in quickstart? if so you cant use quickstart because it is not customisable: https://datahubspace.slack.com/archives/C029A3M079U/p1635469422117000?thread_ts=1635451263.110700&cid=C029A3M079U
    e

    early-lamp-41924

    9 months ago
    Note that you could go ahead and update the yaml file used by quickstart https://github.com/linkedin/datahub/blob/master/docker/quickstart/docker-compose-without-neo4j.quickstart.yml#L49 (all local db related configs are on datahub-gms env) and use the following command to use your local yaml for deploy
    datahub docker quickstart --quickstart-compose-file <<path-to-above-file>>
    note that this will use your mysql as the main db (not just backup)
    f

    full-area-6720

    9 months ago
    Thanks you @better-orange-49102 @early-lamp-41924 I will try this