Join Slack
Powered by
Hello All, <https://docs.pinot.apache.org/basics/...
# general
p
prateek nigam
09/16/2021, 8:30 AM
Hello All,
https://docs.pinot.apache.org/basics/data-import/batch-ingestion/spark
i am follwing this to configure spark job for ingestion, can we give input staging Directory as HDFS Directory. I don't want to use Hadoop utility jar to ingest data.
k
Ken Krugler
09/16/2021, 5:50 PM
I assume you can use HDFS for the staging directory, since we do that for batch segment generation with Hadoop
Open in Slack
Previous
Next