https://pinot.apache.org/ logo
Join Slack
Powered by
I was running Pinot locally, and wanted to reload ...
# troubleshooting
k
I was running Pinot locally, and wanted to reload some revised data. So I first deleted all segments for the target table via 
curl -v "<http://localhost:9000/segments/mytable?type=OFFLINE>" -XDELETE
, which seemed to work, then re-ran my import job via 
bin/pinot-admin.sh LaunchDataIngestionJob -jobSpecFile <spec file>
, which also seemed to work. But when I run a query, I get
Copy code
ProcessingException(errorCode: 450, message: InternalError: java.net.SocketException: Host is down(connect failed)
m
Hey @Ken Krugler what do you see in the external view and ideal state?
k
Via Zookeeper inspection, or some other way of looking at that data? Sorry, just started working with Pinot…
m
Yes ZK inspector
k
for external view - brokerResource, table_OFFLINE, or leadControllerResource?
for crawldata_OFFLINE, the mapFields{} has every segment state as “ERROR”
I can dump JSON here if that’s what you’d prefer, let me know - thanks!
Sadly, I’ve restarted the services so I’m worried that the state I’m seeing now isn’t all that helpful to you. What’s the best way to reset everything to fresh, and then try to recreate my problem?
(this is for running Pinot locally, starting up each service via Bash)
m
You can nuke all the jvms if this is local and want to start with clean state
If your data size is large, perhaps the server is OOM’ing?
Segments go in error state when server cannot host them
Server log usually tells why
k
Hmm, if I do that and relaunch Zookeeper, I still see my previous table data in the inspector
Should I also delete the “PinotCluster” node in ZK?
m
Yes
k
So if OOM is the issue, bumping up server JVM (not broker/controller) is what I’d need to do, right?
m
Correct. What’s your total data size? If you load segments MMAPed (table config) the OOM shouldn’t happen
k
Table config says 
“loadMode”: “MMAP”,
m
Ok
k
Total segments *.tar.gz file sizes == 45MB, I had 2GB for server, bumped to 4GB
I restarted everything (ZK first, deleted the PinotCluster node, then everything else) and reimported. Seems to be OK now. i could try deleting all segments and re-importing again, just to see if that puts me into a weird state.
Though I’m happy now trying to craft queries against real data 🙂
m
👍
Although, with MMAP, loading of segments should not OOM. Query processing happens on heap though
k
Thanks @Mayank
m
👍
Open in Slack
PreviousNext
Powered by