Hi guys, ive been trying to ingest databricks unit...
# troubleshoot
b
Hi guys, ive been trying to ingest databricks unity catalog tables in datahub and everything is successful other than the lineage (it's not visible), i'm not sure why it's not being ingested, I've explicitly configured
include_table_lineage
&
include_column_lineage
to
true
in the yaml recipe. The lineage appears fine in databricks unity catalog as seen in the image attached, but when looking at the lineage for the same table in datahub, the lineage is not visible đŸ˜• Would really appreciate it if someone can direct me on how to fix this
d
hmm, weird, do you see any error in the logs?
no, unity catalog should work without the spark integration. I will test it on my side and get back to you
b
Sure, thanks alot Tamas!
d
let me try to reproduce on my side
s
@dazzling-judge-80093 Actually I got it to work, was able to rerun the yaml and ingest but the lineage came out looking different is the new problem I have.
I had one other question @dazzling-judge-80093 does the users have to be sync-ed somehow between UC and Datahub in order for the owners to populate on the Datahub side
d
owners are not populated because there is no guarantee your users is the same in datahub then here. You can check the owner on the Dataset Properties page if you can see
s
thanks just wanted to check that’s the expected behavior. let me know if there’s way to report a bug for the lineage issue.