I am trying to add fine grained lineage at datajob...
# troubleshoot
f
I am trying to add fine grained lineage at datajob level The lineage is something like dataset1.column1 ----------> datajob ---------------> dataset2.column2 This is the sample code for it
Copy code
fineGrainedLineages = [
    FineGrainedLineage(
        upstreamType=FineGrainedLineageUpstreamType.FIELD_SET,
        upstreams=[fldUrn("dataset1", "column1")],
        downstreamType=FineGrainedLineageDownstreamType.FIELD,
        downstreams=[fldUrn("dataset2", "column2")],
    )
]

dataJobInputOutput = DataJobInputOutputClass(
    inputDatasets=[datasetUrn("dataset1")],
    outputDatasets=[datasetUrn("dataset2")],
    inputDatajobs=None,
    inputDatasetFields=[
        fldUrn("dataset1", "column1"),
    ],
    outputDatasetFields=[
        fldUrn("dataset2", "column2")
    ],
    fineGrainedLineages=fineGrainedLineages,
)

dataJobLineageMcp = MetadataChangeProposalWrapper(
    entityUrn=builder.make_data_job_urn("spark", "data-flow", "datajob1", "DEV"),
    aspect=dataJobInputOutput,
    changeType=ChangeTypeClass.UPSERT,
    entityType='datajob',
    aspectName='dataJobInputOutput'
)

# Create an emitter to the GMS REST API.
emitter = DatahubRestEmitter("<http://localhost:8080>")

# Emit metadata!
result = emitter.emit_mcp(dataJobLineageMcp)
but it's not showing lineage on UI, what could be the reason behind it? (I am using version 0.9.2)
✅ 1
h
Hey, this feature is not supported yet on UI. Do upvote this feature request to show your interest - https://feature-requests.datahubproject.io/p/show-datajob-finegrained-lineage-in-ui