fierce-electrician-85924
02/22/2023, 10:16 AMfineGrainedLineages = [
FineGrainedLineage(
upstreamType=FineGrainedLineageUpstreamType.FIELD_SET,
upstreams=[fldUrn("dataset1", "column1")],
downstreamType=FineGrainedLineageDownstreamType.FIELD,
downstreams=[fldUrn("dataset2", "column2")],
)
]
dataJobInputOutput = DataJobInputOutputClass(
inputDatasets=[datasetUrn("dataset1")],
outputDatasets=[datasetUrn("dataset2")],
inputDatajobs=None,
inputDatasetFields=[
fldUrn("dataset1", "column1"),
],
outputDatasetFields=[
fldUrn("dataset2", "column2")
],
fineGrainedLineages=fineGrainedLineages,
)
dataJobLineageMcp = MetadataChangeProposalWrapper(
entityUrn=builder.make_data_job_urn("spark", "data-flow", "datajob1", "DEV"),
aspect=dataJobInputOutput,
changeType=ChangeTypeClass.UPSERT,
entityType='datajob',
aspectName='dataJobInputOutput'
)
# Create an emitter to the GMS REST API.
emitter = DatahubRestEmitter("<http://localhost:8080>")
# Emit metadata!
result = emitter.emit_mcp(dataJobLineageMcp)
but it's not showing lineage on UI, what could be the reason behind it? (I am using version 0.9.2)hundreds-photographer-13496
02/22/2023, 1:27 PM