Hello, I'm trying to set up an enrichment process ...
# troubleshoot
n
Hello, I'm trying to set up an enrichment process as a lineage from a dataset to itself (=self referencing lineage). For this I want to use column lineage to visualise that one field is calculated based on two others. To accomplish this, I have created the metadata through the Python SDK using the metachangeproposalwrapper but when I try to visualise the self referencing lineage no lineages are shown in Datahub. However, if I add another lineage from that dataset to another, then I can visualise not only that link but also the self referencing lineage is shown on the UI. How would you recommend I deal with self referencing lineages? It would seem to me that this isn't really supported in Datahub? eg:
l
Hey there 👋 I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request. Let's double check a few things first: ✅ There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? ✅ button 2️⃣ It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? Yes button Did you find a solution to your issue?
n
no, didn't find a solution
a
I don’t believe self-reference is currently supported- it would be a good feature request https://feature-requests.datahubproject.io
We may also accept a contribution here!
n
Top, I will raise this as a feature idea.
One more Q, would working through a job perhaps be a work around for this? I've tried but the visual wasn't great either. + I couldn't see the column lineage