i am facing this error , please help me !!!
# ingestion
h
i am facing this error , please help me !!!
s
I had the same issue, try using spark 3.2
According to the documentation, it has been tested with spark 3.2 but not 3.3 or 3.4 https://datahubproject.io/docs/metadata-integration/java/spark-lineage/#spark-versions-supported
h
oh
hold up
i just test with io.acryldatahub spark lineage0.8.30
and its ok
and i dont know why
s
Probably because 0.8.30 does not use the spark
JsonProtocol
class (which causes the issue in your screenshot)
h
i am using spark 3.4.0
oh , Thank you so much
so best practice is using spark 3.2.0 and io.acryldatahub spark lineage0.8.23 ?
or using the newest version of io.acryl:datahub-spark-lineage
s
I think the latest
io.acryl:datahub-spark-lineage
with Spark
3.2.x
? Or opening a PR to make datahub comaptible with the latest spark??? 😁😉