Hi team, I'm testing to ingest column-level lineag...
# ingestion
n
Hi team, I'm testing to ingest column-level lineage between my hive datasets. I've ingested fine-grained lineage, in dataset-datajob-dataset form, following the example here (https://datahubproject.io/docs/generated/metamodel/entities/dataset/#fine-grained-lineage). I expected to see column lineage, but column lineage toggle shows nothing. I can see table level lineage though. (dataset - datajob - dataset) Also I can see new record with aspect='dataJobInputOutput' is created in mysql metadata_aspect_v2. Should I make dataset-dataset form lineage to see column-level lineage? Or did I miss something in making dataset-datajob-dataset lineage?
šŸ” 1
šŸ“– 1
l
Hey there šŸ‘‹ I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request. Let's double check a few things first: āœ… There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? āœ… button āœ… It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? āœ… button Did you find a solution to your issue? āŒ Sorry you weren't able to find a solution. I'm sending you some tips on info you can provide to help the community troubleshoot. Whenever you feel your issue is solved, please react āœ… to your original message to let us know!
n
My datahub version is 0.10.2.2 and I implemented it using quickstart on docker.
But it seems possible to show both levels of lineage at the same time somehow... • dataset-datajob-dataset lineage (table-level) • dataset-dataset lineage (column-level) https://datahubspace.slack.com/archives/C01806GCSD7/p1678984229966439