```/Users/nishchayagarwal/venv-test/bin/Python /Us...
# getting-started
s
Copy code
/Users/nishchayagarwal/venv-test/bin/Python /Users/nishchayagarwal/IdeaProjects/prism-catalog/lineage/staging/datahub_spark_lineage.py
Ivy Default Cache set to: /Users/nishchayagarwal/.ivy2/cache The jars for the packages stored in: /Users/nishchayagarwal/.ivy2/jars :: loading settings :: url = jarfile/Users/nishchayagarwal/venv-test/lib/python3.8/site-packages/pyspark/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml io.acryl#datahub-spark-lineage added as a dependency :: resolving dependencies :: org.apache.spark#spark-submit-parent-b55a9793-fa10-4aae-a4dc-9d489478e53f;1.0 confs: [default] found io.acryl#datahub-spark-lineage;0.8.43 in central :: resolution report :: resolve 148ms :: artifacts dl 2ms :: modules in use: io.acryl#datahub-spark-lineage;0.8.43 from central in [default] --------------------------------------------------------------------- | | modules || artifacts | | conf | number| search|dwnlded|evicted|| number|dwnlded| --------------------------------------------------------------------- | default | 1 | 0 | 0 | 0 || 1 | 0 | --------------------------------------------------------------------- :: retrieving :: org.apache.spark#spark-submit-parent-b55a9793-fa10-4aae-a4dc-9d489478e53f confs: [default] 0 artifacts copied, 1 already retrieved (0kB/4ms) 22/08/24 180227 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 22/08/24 180229 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041. SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. Process finished with exit code 0
b
hey Nishchay - I think this post might be helped better in the #ingestion channel, although John might have an idea as to what is going on. Also, when posting code blocks and logs, can you please put them as a thread comment under one main post in the channel? This helps keep the main thread of the channel cleaner and easier for the core datahub team to keep track of what questions have not been answered / who still needs help.
s
sure
@big-carpet-38439 can you please help