https://pinot.apache.org/ logo
a

ayush sharma

03/19/2021, 3:16 PM
Hi everyone, I am facing an issue while ingesting batch data into Pinot. The command to ingest the data executes successfully,
Copy code
$ pinot-admin.sh LaunchDataIngestionJob -jobSpecFile /home/ayush/ayush_workspace/iVoyant/analytics/data/hospital_data/job-spec.yml
.....
Pushing segment: hospital to location: <http://localhost:9000> for table hospital
Sending request: <http://localhost:9000/v2/segments?tableName=hospital> to controller: 4cb684aaf215, version: Unknown
Response for pushing table hospital segment hospital to location <http://localhost:9000> - 200: {"status":"Successfully uploaded segment: hospital of table: hospital"}
But, the table status on UI turns BAD Here is the Error logged in pinot-server:
2021/03/19 15:03:24.082 ERROR [SegmentOnlineOfflineStateModelFactory$SegmentOnlineOfflineStateModel] [HelixTaskExecutor-message_handle_thread] Caught exception in state transition from OFFLINE -> ONLINE for resource: hospital_OFFLINE, partition: hospital
java.lang.IllegalStateException: Key separator not found: APR, segment: /tmp/pinotServerData/hospital_OFFLINE/hospital/v3
at shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:444)
Any idea? what could be wrong here ? I have attached the error log. Any help is appreciated !
I did not realize that I was dealing with column names having spaces in it. Removing the spaces in the column names, worked out
👍 1
x

Xiang Fu

03/19/2021, 9:11 PM
which column has space? in schema?
a

ayush sharma

03/19/2021, 9:45 PM
Most of the column names had space in it. As well the column names mentioned in the schema had space in it. The column names were exactly same in both the csv file and schema.json
x

Xiang Fu

03/19/2021, 9:46 PM
oic, then we should try to prevent creating schema in Pinot then 😛
🙃 1
and give the error msg