Hi Team I just installed Pinot locally and I ran the script

Question

Hi Team I just installed Pinot locally and I ran the script ``` bin quick start batch sh``` It is throwing an error ``` Offline quickstart setup complete Total number of documents in the table Query select count from baseballStats limit 0 Executing command PostQuery brokerHost 127 0 0 1 brokerPort 8000 queryType pql query select count from baseballStats limit 0 Exception in thread main java lang NullPointerException at org apache pinot tools Quickstart prettyPrintResponse Quickstart java 75 at org apache pinot tools Quickstart execute Quickstart java 174 at org apache pinot tools Quickstart main Quickstart java 207 ``` This is how the UI looks like

Cinto Sunny · Answer

Maybe data is not there

Mayank · Answer

< Neha Pawar> any idea ^^

Jackie · Answer

There is no live segment on server side

Jackie · Answer

< Cinto Sunny> Can you please share the OS and java version you are running with

Cinto Sunny · Answer

OS Version MAC OS 10 15 1 19B88 ```java version java version 1 8 0 201 ```

Cinto Sunny · Answer

I can try uploading separately I assumed the start batch sh will upload some files

Xiang Fu · Answer

it will which binary you are using and download from

Cinto Sunny · Answer

apache pinot incubating 0 4 0 bin

Cinto Sunny · Answer

Pinot server log for reference

Xiang Fu · Answer

from the log segment is loaded

Mayank · Answer

< Cinto Sunny> As < Xiang Fu> pointed out seems like the segment was uploaded Can you issue the query again and share the broker side log for the query

Cinto Sunny · Answer

In the broker logs I see a new request RequestId 9 but no data is retrieved in the UI

Mayank · Answer

```2020 07 01 10 48 15 967 INFO BaseBrokerRequestHandler jersey server managed async executor 11 RequestId 14 table baseballStats OFFLINE timeMs 4 docs 0 0 entries 0 0 segments queried processed matched consuming unavailable 0 0 0 0 0 consumingFreshnessTimeMs 0 servers 0 1 groupLimitReached false exceptions 0 serverStats ```

Mayank · Answer

Seems like 0 1 servers responded

Jackie · Answer

Yes server didn t respond

Mayank · Answer

What s the server log snippet around when the query happens

Jackie · Answer

Based on the server log it didn t even get the query

Mayank · Answer

hmm But is the log from when the query was issued

Jackie · Answer

Might be some security settings on the laptop

Cinto Sunny · Answer

The last log from server is 2020 07 01 10 56 23 463 ```2020 07 01 10 56 23 463 INFO HelixInstanceDataManager HelixTaskExecutor message handle thread Created table data manager for table baseballStats OFFLINE 2020 07 01 10 56 23 585 INFO HelixInstanceDataManager HelixTaskExecutor message handle thread Added segment baseballStats OFFLINE 0 to table baseballStats OFFLINE 2020 07 01 10 56 23 585 INFO SegmentFetcherAndLoader HelixTaskExecutor message handle thread Downloaded segment baseballStats OFFLINE 0 of table baseballStats OFFLINE crc 3938111273 from controller```

Jackie · Answer

```2020 07 01 10 44 52 046 INFO SegmentFetcherAndLoader HelixTaskExecutor message handle thread Downloaded segment baseballStats OFFLINE 0 of table baseballStats OFFLINE crc 3938111273 from controller 2020 07 01 10 56 16 636 INFO HelixServerStarter main Starting Pinot server```

Cinto Sunny · Answer

The last log from broker is 2020 07 01 13 08 35 302 ```2020 07 01 13 08 35 302 INFO BaseBrokerRequestHandler jersey server managed async executor 11 RequestId 17 table baseballStats OFFLINE timeMs 4 docs 0 0 entries 0 0 segments queried processed matched consuming unavailable 0 0 0 0 0 consumingFreshnessTimeMs 0 servers 0 1 groupLimitReached false exceptions 0 serverStats Server=SubmitDelayMs ResponseDelayMs ResponseSize DeserializationTimeMs 127 0 0 1 O=2 1 0 0 query select AtBatting from baseballStats limit 10```

Jackie · Answer

Did you re run the script between 10 44 52 and 10 56 16

Cinto Sunny · Answer

So when the query is fired the server is not responding

Cinto Sunny · Answer

Yes I believe I cancelled and reran the script

Cinto Sunny · Answer

not sure of the exact time

Cinto Sunny · Answer

I reran because of this issue ``` Launch data ingestion job to build index segment for baseballStats and push to controller Waiting for 5 seconds for the server to fetch the assigned segment Offline quickstart setup complete Total number of documents in the table Query select count from baseballStats limit 0 Executing command PostQuery brokerHost 127 0 0 1 brokerPort 8000 queryType pql query select count from baseballStats limit 0 Exception in thread main java lang NullPointerException at org apache pinot tools Quickstart prettyPrintResponse Quickstart java 75 at org apache pinot tools Quickstart execute Quickstart java 174 at org apache pinot tools Quickstart main Quickstart java 207 ```

Jackie · Answer

This could be the same issue where server didn t get the request

Cinto Sunny · Answer

I am looking at ZooInspector and I see this

Mayank · Answer

What do you see in external view

Cinto Sunny · Answer

What is external view

Mayank · Answer

See left hand side of zoo inspector image you posted

Mayank · Answer

Hmm so server is indeed online

Cinto Sunny · Answer

yep

Mayank · Answer

< Jackie> What issue are you referring to where server didn t get the request

Mayank · Answer

Is it something fixed after the release

Mayank · Answer

fwiw I downloaded the release and ran the same test and didn t see any issues

Mayank · Answer

< Cinto Sunny> can you re try for good luck slightly smiling face When you `ctrl c` wait for all processess to be cleaned up

Mayank · Answer

I ran on linux though

Cinto Sunny · Answer

Sure I can check ps and confirm then start again

Mayank · Answer

Also are you running from release or from source code

Cinto Sunny · Answer

From release i downloaded the tar and proceeded with the next steps

Mayank · Answer

From source code worked for me on Mac And release worked for me on linux

Mayank · Answer

let me try downloading the release on Mac

Mayank · Answer

The instruction says ` define the pinot version PINOT VERSION=0 3 0`

Mayank · Answer

that seems wrong since latest release is 0 4 0 Is that what you set

Cinto Sunny · Answer

yes i set 0 4 0

Mayank · Answer

Hmm I downloaded and tried on Mac it still works for me

Cinto Sunny · Answer

hmmm what options I have to debug Somebody mentioned security settings on my mac

Mayank · Answer

Can you try the source code path first

Mayank · Answer

One difference I see between your and my log ``` DeserializationTimeMs 127 0 0 1 O=29```

Mayank · Answer

yours ^^

Mayank · Answer

mine ```DeserializationTimeMs 172 18 168 121 O=2```

Cinto Sunny · Answer

let me try again as you said earlier

Mayank · Answer

ok

Cinto Sunny · Answer

must be some minor issue

Cinto Sunny · Answer

did you try 0 4 0

Mayank · Answer

Yes I downloaded 0 4 0 and ran on my Mac

Cinto Sunny · Answer

ok

Mayank · Answer

If you are on VPN try disconnecting just wild guess

Cinto Sunny · Answer

I tried with 0 3 0 and it gives the same error I also see another error not sure if they are related ```Executing command StartController clusterName QuickStartCluster controllerHost 127 0 0 1 controllerPort 9000 dataDir var folders v0 1cy26sms2rv0x68whkb0jc3r0000gn T PinotController zkAddress localhost 2123 Invalid instance setup missing znode path QuickStartCluster CONFIGS PARTICIPANT Controller 127 0 0 1 9000 Invalid instance setup missing znode path QuickStartCluster INSTANCES Controller 127 0 0 1 9000 MESSAGES Invalid instance setup missing znode path QuickStartCluster INSTANCES Controller 127 0 0 1 9000 CURRENTSTATES Invalid instance setup missing znode path QuickStartCluster INSTANCES Controller 127 0 0 1 9000 STATUSUPDATES Invalid instance setup missing znode path QuickStartCluster INSTANCES Controller 127 0 0 1 9000 ERRORS```

Cinto Sunny · Answer

This is the entire startup sh logs

Cinto Sunny · Answer

I guess VPN was the issue I disconnected from VPN killed some running tasks and it seems to be working Thanks ALL

Mayank · Answer

Oh nice Can you file an issue for the VPN with as much info logs as possible I am on VPN and I didn t see the issue We had this issue several years ago and thought it was addressed

Mayank · Answer

< Cinto Sunny> ^^

Cinto Sunny · Answer

Just created a jira Let me know if anything else is needed I can update <https issues apache org jira browse PINOT 10>

Mayank · Answer

Oh we follow github issues Sorry about that

Cinto Sunny · Answer

ok will create one there

Cinto Sunny · Answer

done <https github com apache incubator pinot issues 5646>