The server hosting our Pinot got rebooted and when...
# troubleshootingj
Josh Highley
03/24/2021, 8:34 PMThe server hosting our Pinot got rebooted and when we restarted the components, we have no segments, no tables and no schemas. I see in the server logs that it's looking in the correct directories for instance data and instance segment, and I've confirmed there's data in those directories. Pinot server isn't loading anything though?
m
Mayank
03/24/2021, 8:35 PM
What do you see in the ideal-state? Does it claim that the server should host data?
j
Josh Highley
03/24/2021, 8:37 PMwhere do I check that?
m
Mayank
03/24/2021, 8:38 PM
In the cluster manager or in zookeeper (via query console)
Mayank
03/24/2021, 8:38 PM
Ideal-state reflects which segments are "expected" to be on which servers.
Mayank
03/24/2021, 8:38 PM
External-view reflects the current state of the system.
Mayank
03/24/2021, 8:39 PM
Let's first see what Ideal-State says. If it claims that the server should host segments, then we check external view.
j
Josh Highley
03/24/2021, 8:39 PMthose only have 'brokerResource' and 'leadControllerResource'
m
Mayank
03/24/2021, 8:40 PM
Hmm, nothing for the table?
j
Josh Highley
03/24/2021, 8:41 PMunder idealStates? no
m
Mayank
03/24/2021, 8:41 PM
Does cluster manager show any tables tab?
Mayank
03/24/2021, 8:42 PM
or the rest-api
<controllerHost>:<controllerPort>/tablesMayank
03/24/2021, 8:42 PM
If none of them show the table, then there is no table 😬
j
Josh Highley
03/24/2021, 8:46 PMugh. pinot-admin.sh doesn't log correctly so we don't even have log files
m
Mayank
03/24/2021, 9:05 PM
I think it should log correctly, unless you have overwritten log4j configs?
Mayank
03/24/2021, 9:05 PM
If you still feel it is not doing so, please file an issue and we will address it.
j
Jackie
03/24/2021, 10:22 PMIf only these 2 records exist in ideal state, you need to check if zookeeper somehow gets all the contents deleted during the reboot