Hi Everyone, I am looking so any java/Scala imple...
# ingestion
p
Hi Everyone, I am looking so any java/Scala implementation or example of data ingestion. I looked at the Maven report for
datahub
but didn’t find event dictionary jar/classes. like we have for Python in ingestion module.
l
we don't yet have the equivalent java/scala support. Which source are you trying to ingest from?
p
Data Processing framework like Spark/Flink/KStream for Pipeline and Lineage , we have custom dashboard service to push Dashboard information. Also looking at Trino/Presto Data Source. I can achieve using
sqlalchemy
but I am also planning to add Lineage from catalog source in Trino
m
@prehistoric-yak-75049: this has been a long standing request. We'll get to it next week. I'll DM you for details.
👍 1