Any plans for integrating <Spline> in DataHub?
It ...
# ingestionn
numerous-yak-58823
10/08/2021, 7:43 PMAny plans for integrating Spline in DataHub?
It would unlock really powerful features like Spark automatic lineage even at column level.
👍 1
l
loud-island-88694
10/08/2021, 7:46 PM
Yes - we are actively investigating this. Please stay tuned for updates
🙌 1
n
numerous-yak-58823
10/08/2021, 7:51 PMgreat news!!! thank you very much!!!
s
square-bear-74875
01/10/2022, 1:38 PMHi @loud-island-88694, @best-father-28132 and I are interested to know how this has progressed. Can you advise?
l
loud-island-88694
01/11/2022, 2:01 AM
Great to know you both are interested. We do have spark lineage emitter released. Documentation is here: https://datahubproject.io/docs/metadata-integration/java/spark-lineage/
loud-island-88694
01/11/2022, 2:01 AM
Would be great to get your feedback about how it is working @square-bear-74875 @best-father-28132
loud-island-88694
01/11/2022, 2:02 AM
@careful-pilot-86309 can help with answering any questions or troubleshooting
loud-island-88694
01/11/2022, 2:02 AM
support for more features (column-level lineage, support for databricks spark etc.) will be added over the coming months
loud-island-88694
01/11/2022, 2:03 AM
also cc @elegant-doctor-86344