colossal-sandwich-50049
07/13/2022, 9:35 PMdatahub-protobuf module described in this documentation (https://github.com/datahub-project/datahub/tree/master/metadata-integration/java/datahub-protobuf) but can't seem to find it on maven; can someone advise?
2. After running the code below with java emitter (using Scala below), I have found that some of the methods on DatasetProperties (e.g. setTags, setQualifiedName) don't alter anything in the user interface; can someone advise? Follow up: I notice, based on maven, that the datahub-client is fairly new; would it be fair to say that it's functionality is still fairly limited?
val emitter: RestEmitter = RestEmitter.create(b => b
.server("<http://localhost:8080>")
.extraHeaders(Collections.singletonMap("Custom-Header", "custom-val"))
)
// emitter.testConnection()
val tags = new StringArray()
tags.add("featureStore")
tags.add("bi")
val url = new Url("<https://www.denofgeek.com/>")
val customProperties = new StringMap()
customProperties.put("governance", "disabled")
customProperties.put("otherProp", "someValue")
val mcpw = MetadataChangeProposalWrapper.builder()
.entityType("dataset")
.entityUrn("urn:li:dataset:(urn:li:dataPlatform:delta-lake,fraud.feature-stores.feature-store-v1,PROD)")
.upsert
.aspect(
new DatasetProperties()
.setName("feature-store")
.setDescription("some feature store desc")
.setTags(tags, SetMode.DISALLOW_NULL) // SetMode.IGNORE_NULL
.setQualifiedName("fraudFeatureStore")
.setExternalUrl(url)
// .setUri(new URI("<https://www.geeksforgeeks.org/>"))
.setCustomProperties(customProperties)
)
.build
val requestFuture = emitter.emit(mcpw, null).get()careful-pilot-86309
07/14/2022, 12:02 PMglobalTags aspect of the dataset. Please refer to this and this. ( these are in python but you will get fair idea on how to do it)
3. Java emitter is fully functional. Let us know if anything is not working for you. We have wide range of example of how to emit thing in python at this location. you can always refer there.colossal-sandwich-50049
07/14/2022, 5:51 PMimport datahub.protobuf.ProtobufDataset; ?colossal-sandwich-50049
07/14/2022, 6:01 PMcolossal-sandwich-50049
07/15/2022, 2:25 PMcareful-pilot-86309
07/15/2022, 2:25 PMmammoth-bear-12532
mammoth-bear-12532
colossal-sandwich-50049
09/12/2022, 5:38 PM