Ravikumar Maddi
04/19/2021, 2:32 PMbin/pinot-ingestion-job.sh -jobSpec examples/batch/airlineStats/ingestionJobSpec.yaml
The error:
ERROR [LaunchDataIngestionJobCommand] [main] Error: "-jobSpec" is not a valid option
Need your help...Xiang Fu
-jobSpecFile
Xiang Fu
# inputDirURI: Root directory of input data, expected to have scheme configured in PinotFS.
inputDirURI: 's3://<my-bucket>/path/to/root/input/data'
# includeFileNamePattern: include file name pattern, supported glob pattern.
# Sample usage:
# 'glob:*.avro' will include all avro files just under the inputDirURI, not sub directories;
# 'glob:**/*.avro' will include all the avro files under inputDirURI recursively.
includeFileNamePattern: 'glob:**/*.avro'
Ravikumar Maddi
04/20/2021, 8:43 AMRavikumar Maddi
04/20/2021, 8:45 AMRavikumar Maddi
04/20/2021, 8:49 AMRavikumar Maddi
04/20/2021, 8:50 AMRavikumar Maddi
04/20/2021, 9:03 AMXiang Fu
Xiang Fu
bin/pinot-ingestion-job.sh -jobSpecFile ~/temp/github-data/githubActivities/ingestionJobSpec.yaml
Xiang Fu