Hi Guys!
I set up databricks spark lineage, but i dont see any pipeline on datahub after execute a notebook on databricks. The logs shows that listener ir registrated, but any datahub emitter message is not exists on logs.
Any help?
d
dazzling-judge-80093
06/29/2023, 6:49 PM
Is it an option to use unity catalog?
I think if you run it from a notebook then it doesn’t close the app properly and lineage plug-in doesn’t get the proper event
g
gentle-arm-6777
08/16/2023, 5:23 PM
I found response!
If you to use Jobs workflows, It is should works fine!