https://pinot.apache.org/ logo
j

Josh Highley

03/24/2021, 8:34 PM
The server hosting our Pinot got rebooted and when we restarted the components, we have no segments, no tables and no schemas. I see in the server logs that it's looking in the correct directories for instance data and instance segment, and I've confirmed there's data in those directories. Pinot server isn't loading anything though?
m

Mayank

03/24/2021, 8:35 PM
What do you see in the ideal-state? Does it claim that the server should host data?
j

Josh Highley

03/24/2021, 8:37 PM
where do I check that?
m

Mayank

03/24/2021, 8:38 PM
In the cluster manager or in zookeeper (via query console)
Ideal-state reflects which segments are "expected" to be on which servers.
External-view reflects the current state of the system.
Let's first see what Ideal-State says. If it claims that the server should host segments, then we check external view.
j

Josh Highley

03/24/2021, 8:39 PM
those only have 'brokerResource' and 'leadControllerResource'
m

Mayank

03/24/2021, 8:40 PM
Hmm, nothing for the table?
j

Josh Highley

03/24/2021, 8:41 PM
under idealStates? no
m

Mayank

03/24/2021, 8:41 PM
Does cluster manager show any tables tab?
or the rest-api
<controllerHost>:<controllerPort>/tables
?
If none of them show the table, then there is no table 😬
j

Josh Highley

03/24/2021, 8:46 PM
ugh. pinot-admin.sh doesn't log correctly so we don't even have log files
m

Mayank

03/24/2021, 9:05 PM
I think it should log correctly, unless you have overwritten log4j configs?
If you still feel it is not doing so, please file an issue and we will address it.
j

Jackie

03/24/2021, 10:22 PM
If only these 2 records exist in ideal state, you need to check if zookeeper somehow gets all the contents deleted during the reboot