<@UGRJA9TEH> Hi, where can I download the spark c...
# troubleshooting
n
@Xiang Fu Hi, where can I download the spark connector jar for pinot, I have use case to read from pinot and write to s3. I'm exploring possibilities using spark. Can someone pls assist with the configuration details for spark,pinot.. I tried with spark 3.5.8 and pinot 1.4 , I built jar from spark-connector directory using -
pbuild-shaded-jar
command. However I'm facing following error when I try to submit my pyspark code via spark submit utility
x
See if all the required jars are loaded.
You may need to import more jars from Pinot-distribution
n
@Xiang Fu that's where I'm struggling, how can I find the dependent jars for my usecase. If would be really helpful if you could share some insights on this
x
build pinot project and in
pinot-distribution
's
targets
directory