witty-keyboard-20400
10/04/2021, 12:20 PMbootstrap_mce.json
regarding datasets appearing under browse path "prod":
"com.linkedin.pegasus2avro.metadata.snapshot.DatasetSnapshot": {
"urn": "urn:li:dataset:(urn:li:dataPlatform:hive,SampleHiveDataset,PROD)",
"aspects": [
{
"com.linkedin.pegasus2avro.common.Ownership": {
"owners": [
{
"owner": "urn:li:corpuser:jdoe",
"type": "DATAOWNER",
"source": null
},
{
"owner": "urn:li:corpuser:datahub",
"type": "DATAOWNER",
"source": null
}
],
"lastModified": {
"time": 1581407189000,
"actor": "urn:li:corpuser:jdoe",
"impersonator": null
}
}
},
{
"com.linkedin.pegasus2avro.dataset.UpstreamLineage": {
For the above mentioned Hive dataset, there is no mention of following type of BrowsePaths
the ways Kafka and Hdfs DatasetSnapshot.
"com.linkedin.pegasus2avro.common.BrowsePaths": {
"paths": ["/prod/kafka/Sample..."]
}
How is the path /prod/hive/SampleHiveDataset
appearing on the UI ?
OTOH, I see several ML snapshot mentioning browse paths, but those don't appear on the UI. e.g.
"com.linkedin.pegasus2avro.metadata.snapshot.MLFeatureTableSnapshot": {
"urn": "urn:li:mlFeatureTable:(urn:li:dataPlatform:feast,test_feature_table_no_labels)",
"aspects": [
{
"com.linkedin.pegasus2avro.common.BrowsePaths": {
"paths": ["/feast/test_feature_table_no_labels"]
}
},
What is the criteria on which some are displayed under browse paths on the UI?green-football-43791
10/04/2021, 2:13 PMgreen-football-43791
10/04/2021, 2:14 PM