Hello! delete dataset "aspects": [ { "com.linkedin.pegasus2avro.common.Status": { "removed": null } please help delete schema

[{
    "auditHeader": null,
    "proposedSnapshot": {
        "com.linkedin.pegasus2avro.metadata.snapshot.DatasetSnapshot": {
            "urn": "urn:li:dataset:(urn:li:dataPlatform:kafka,SampleKafkaDataset,PROD)",
            "aspects": [
                {
                    "com.linkedin.pegasus2avro.common.Status": {
                        "removed": true
                    }
                }
            ]
        }
    }
}]

try this?

^ +1

you can still find it in UI if there is a lineage that leads to it though

Yes. We added a task for this! We will get to this soon. cc @green-football-43791

how delete schema from ui ?

Are you trying to update schema or delete the dataset as a whole?

update schema to null )

So basically hide the schema? Each row in the schema table is set https://github.com/linkedin/datahub/blob/master/metadata-models/src/main/pegasus/com/linkedin/schema/SchemaField.pdl#L19 https://github.com/linkedin/datahub/blob/master/metadata-models/src/main/pegasus/com/linkedin/schema/SchemaMetadata.pdl#L49 So if you set the SchemaMetadata “fields” to an empty array, you will be able to clear the schema

@early-lamp-41924 Can I ask whether I can hide the whole database instead of just one dataset

unfortunately removing based on search (i.e. search for datasets in the db) is not supported right now. For now, you could perform a search request to gms and generate the above mce (for setting removed to true) for each dataset in the search response

on this topic, sorry to side-track but search request to GMS only returns version 0 of each dataset in MySQL right?

Search in gms as of now returns urns that match the query

cool, thanks. was thinking of a side project that explores the past changes to datasets. but seems to me that i should query the MySQL database directly

we have a PR out that adds historical versions of entities to the UI! If that is what you are looking for

sounds relevant! but i dont see it in the PR list now?

actually realized its merged

its currently exists as endpoint only right? the UI will be updated to to utilise it?

yes! cc @green-football-43791

Yes- work is currently in progress to have the UI read historical schemas

@green-football-43791 @early-lamp-41924 Seems like I still can get some hints for deleted datasets

Hung Nguyen are you not like scripts? ) i think "auditHeader": null, "proposedSnapshot": { "com.linkedin.pegasus2avro.metadata.snapshot.DatasetSnapshot": { i agree that it 's rather difficult to understand and use)