Due to the inability to add column-level lineage o...
# all-things-deploymentt
tall-gigabyte-99212
08/31/2023, 10:36 AMDue to the inability to add column-level lineage on the webUI, only table-level lineage can be added. How can I add column-level lineage?Therefore, I would like to know how column-level lineage is stored in MySQL. I noticed that table-level lineage is stored as "aspect:upstreamLineage" in the table metadata_aspect_v2. Can someone provide an answer? It would be great if a sample data of column-level lineage can be provided, or even a sample image. Just like mine:😊
a
aloof-gpu-11378
09/01/2023, 6:41 AM@bitter-author-2524 might be able to speak to this!
t
tall-gigabyte-99212
09/01/2023, 6:47 AMI have referred to the official website and added column lineage using a Python script, but the official website https://datahubproject.io/docs/api/tutorials/lineage/#add-column-level-lineage does not provide instructions on how to add column-level lineage between multiple columns in two tables using Python.
For example:
table1 table2
id--------->id1
name------->name1
a
aloof-gpu-11378
09/01/2023, 10:34 PMHi @tall-gigabyte-99212, I'm sorry you're having trouble with column-level lineage. @famous-waitress-64616 do you think you could help out here?
aloof-gpu-11378
09/06/2023, 4:30 PMEach
FineGrainedLineage Copy code
fineGrainedLineages = [
FineGrainedLineage(upstreamType=FIELD_SET, upstreams=[fldUrn("table1", "id")], downstreamType=FIELD, downstreams=[fldUrn("table2", "id1")]),
FineGrainedLineage(upstreamType=FIELD_SET, upstreams=[fldUrn("table1", "name")], downstreamType=FIELD, downstreams=[fldUrn("table2", "name1")]),
]