Hi, I am getting error when I run `bin/pinot-ing...
# troubleshooting
r
Hi, I am getting error when I run
bin/pinot-ingestion-job.sh -jobSpec examples/batch/airlineStats/ingestionJobSpec.yaml
The error: ERROR [LaunchDataIngestionJobCommand] [main] Error: "-jobSpec" is not a valid option Need your help...
x
try
-jobSpecFile
Copy code
# inputDirURI: Root directory of input data, expected to have scheme configured in PinotFS.
inputDirURI: 's3://<my-bucket>/path/to/root/input/data'

# includeFileNamePattern: include file name pattern, supported glob pattern.
# Sample usage:
#   'glob:*.avro' will include all avro files just under the inputDirURI, not sub directories;
#   'glob:**/*.avro' will include all the avro files under inputDirURI recursively.
includeFileNamePattern: 'glob:**/*.avro'
r
I tried -jobSpec, -jobSpecFile but no lock,
I am trying to do batch process and get from S3 bucket and keeping(Pinot segment store) in local machine.
input data in json format.
I gone through the most of all pinot documentation. There are multiple scenarios with multiple combinations. Could you please guide me which I have to pick.
My doubt is, in my scenario, job(*job.yaml) needed or not?
x
try to use absolute path? what’s the error?
I’m using this and it works fine
Copy code
bin/pinot-ingestion-job.sh -jobSpecFile ~/temp/github-data/githubActivities/ingestionJobSpec.yaml
which pinot version are you on?