polite-application-51650
03/28/2022, 7:05 AMspark = SparkSession.builder()
.appName("test-application")
.config("spark.master", "<spark://spark-master:7077>")
.config("spark.jars.packages","io.acryl:datahub-spark-lineage:0.8.23")
.config("spark.extraListeners", "datahub.spark.DatahubSparkListener")
.config("spark.datahub.rest.server", "<http://localhost:8080>")
.enableHiveSupport()
.getOrCreate();
this is what I setup in my spark config file.careful-pilot-86309
03/28/2022, 10:26 AM