Hello! DataMap should have no more than one entry ...
# troubleshoot
c
Hello! DataMap should have no more than one entry for a union tell me please how to fix it?
{"exceptionClass":"com.linkedin.restli.server.RestLiServiceException","stackTrace":"com.linkedin.restli.server.RestLiServiceException [HTTP Status500] java.lang.RuntimeException: java.lang.reflect.InvocationTargetException\n\tat com.linkedin.metadata.restli.RestliUtil.toTask(RestliUtil.java:42)\n\tat com.linkedin.metadata.restli.RestliUtil.toTask(RestliUtil.java:50)\n\tat com.linkedin.metadata.resources.entity.EntityResource.ingest(EntityResource.java:204)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:498)\n\tat com.linkedin.restli.internal.server.RestLiMethodInvoker.doInvoke(RestLiMethodInvoker.java:177)\n\tat com.linkedin.restli.internal.server.RestLiMethodInvoker.invoke(RestLiMethodInvoker.java:333)\n\tat com.linkedin.restli.internal.server.filter.FilterChainDispatcherImpl.onRequestSuccess(FilterChainDispatcherImpl.java:47)\n\tat com.linkedin.restli.internal.server.filter.RestLiFilterChainIterator.onRequest(RestLiFilterChainIterator.java:86)\n\tat com.linkedin.restli.internal.server.filter.RestLiFilterChainIterator.lambda$onRequest$0(RestLiFilterChainIterator.java:73)\n\tat java.util.concurrent.CompletableFuture.uniAccept(CompletableFuture.java:670)\n\tat java.util.concurrent.CompletableFuture.uniAcceptStage(CompletableFuture.java:683)\n\tat java.util.concurrent.CompletableFuture.thenAccept(CompletableFuture.java:2010)\n\
d
Hey @cuddly-lunch-28022, please can you give us more detail what you tried to do?
c
1. install recipe https://datahubproject.io/docs/metadata-ingestion/source_docs/mssql/ 2. get 2 tabels with columns =2 datasets 3. i want to lineage 2 columns but i don't understand where i can do it (i have part json here) https://github.com/datahub-project/datahub/blob/master/docs/rfc/active/1841-lineage/field_level_lineage.md i have long json here without understanding https://datahubproject.io/docs/generated/metamodel/entities/dataset/#datasetupstreamlineage I go there .local:9002/api/graphiql but i have problem too
curl 'http://localhost:8080/entities?action=ingest' -X POST --data '{ "entity":{ "value":{ "com.linkedin.metadata.snapshot.DatasetSnapshot":{ "urn":"urnlidataset:(urnlidataPlatform:foo_sex,PROD)", "aspects":[ { "type": "record", "Aspect": { "name": "upstreamLineage" }, "name": "UpstreamLineage", "namespace": "com.linkedin.dataset", "fields": [ { "type": { "type": "array", "items": { "type": "record", "name": "Upstream", "namespace": "com.linkedin.dataset", "fields": [ { "deprecated": "w
curl 'http://localhost:8080/entities?action=ingest' -X POST --data '{ "entity":{ "value":{ "com.linkedin.metadata.snapshot.DatasetSnapshot":{ "urn":"urnlidataset:(urnlidataPlatform:foo,bar10,PROD)", "aspects":[ { "com.linkedin.common.Ownership":{ "owners":[ { "owner":"urnlicorpuser:fbar", "type":"DATAOWNER" } ] } }, { "com.linkedin.common.DatasetUpstreamLineage":{ "fieldMappings": [ { "created": null, "transformationFunction": { "string": "com.linkedin.finegrainedmetadata.transformation.Identity" }, "sourceFields": [ { "string": "urnlidatasetField:(urnlidataset:(urnlidataPlatform:foo,bar,PROD),/foo)" } ], "destinationField": "urnlidatasetField:(urnlidataset:(urnlidataPlatform:foo,bar_sex,PROD),/foo)" } ] } } ] } } } }'
l
@cuddly-lunch-28022 that RFC is deprecated
we will remove it soon
the right way to emit field level lineage is documented here: https://datahubproject.io/docs/generated/metamodel/entities/dataset/#fine-grained-lineage