https://pinot.apache.org/ logo
Join SlackCommunities
Powered by
Hello Everyone , I am very new to Pinot and having...
# troubleshooting
h
Hello Everyone , I am very new to Pinot and having some trouble getting it up and running on Windows. Was wondering if there are any recourses or video tutorials that I can follow. In a nutshell I am trying to recreate whatever was done in this blog post https://medium.com/apache-pinot-developer-blog/building-a-climate-dashboard-with-apache-pinot-and-superset-d3ee8cb7941d . Thank you in advance.
d
While Pinot is written in Java, there is no packaging wrappers written in favor of Windows. Startup scripts are intended to be ran on Linux or Macos machines.
👍 1
h
Is it possible to utilize Ubuntu ?
d
Of course
👍 1
If you have docker on your windows machine, you should be able to follow Kenny’s tutorial
👍 1
The only cavat is that you will have to run the commands from his bootstrap script manually in a windows terminal rather than executing the shell script https://github.com/kbastani/climate-change-analysis/blob/master/bootstrap.sh
👍 2
h
I have installed Docker desktop and was also able to install Docker version 19.03.8 in Ubuntu. Where would I actually run this commend '$ docker network create PinotNetwork $ docker-compose up -d $ docker-compose logs -f — tail=100
d
in a windows terminal
👍 1
also, you need to install 
docker-compose
I think it is part of Docker deskptop but it worth double checking
👍 1
h
Great ! thanks for you help. I am going to try and not give up on this an get it done 🙂
d
Learning that toolset will be valuable for you for far beyond than Pinot 🙂
🙏 2
h
I am getting this ERROR after running docker-compose up -d in cmd. Can't find a suitable configuration file in this directory or any parent. Are you in the right directory? Supported filenames: docker-compose.yml, docker-compose.yaml
d
I don’t believe you are running the command from the git repository
h
I see ,so I need to navigate to climate-change-analysis folder and then run the commends from the cloned repo ?
d
Yes
👍 1
h
Thank you so much ! everything seems to be working, but when running docker-compose logs -f --tail=100 , I didn't do tail=100 and its taking very long time for checking the logs. Should I wait until it converges or is there a way to stop the commend and start the bootstrap ?
👍 1
d
Pinot is not a small system. You wan with 
docker-compose up -d
so the system is running in background. You can exist your 
docker-compose logs
command and it will not kill the process
✅ 1
docker-compose down
to clean everything. 
docker-compose stop
to pause it
✅ 1
k
@Hakob Avjyan Glad you were able to get up and running. Thanks @Daniel Lavoie
👍 1
h
Thank you guys, I am now able to access Pinot on http://localhost:9000/ . But for some reason password credential admin/admin do not work for superset login ...
also just noticed that instead of stormEvents I have baseballStats ...
k
Make sure you run 
$ sh ./bootstrap.sh
Baseball stats is fine. It's a quick start. But after you run the bootstrap script, it will add all the storm data and events.
👍 1
It might take awhile.
👍 1
Also, hopefully you have at least 16gb memory on your machine.
✅ 1
h
I am running this commends in windows command prompt so it dose not recognize the sh commend, as Daniel suggested I run the commands from your bootstrap script manually...
docker exec -ti pinot_app_noaa bash -c "sh ./import/import-storm-events.sh"
this is what I am getting in response 
: not foundport-storm-events.sh: 2: ./import/import-storm-events.sh:                                                    Adding 'stormEvents' table to Pinot...                                                                                  : not foundport-storm-events.sh: 4: ./import/import-storm-events.sh:                                                    " is not a valid option                                                                                                 : not foundport-storm-events.sh: 7: ./import/import-storm-events.sh:                                                    Downloading CSV files from NOAA server...                                                                               : not foundport-storm-events.sh: 9: ./import/import-storm-events.sh:                                                    --2021-04-14 18:52:34--  <ftp://ftp.ncdc.noaa.gov/pub/data/swdi/stormevents/csvfiles/StormEvents_details-ftp_v1.0_*.csv.gz%0D>                                                                                                                               => '<http://ftp.ncdc.noaa.gov/pub/data/swdi/stormevents/csvfiles/.listing|ftp.ncdc.noaa.gov/pub/data/swdi/stormevents/csvfiles/.listing>'                                           Resolving <http://ftp.ncdc.noaa.gov|ftp.ncdc.noaa.gov> (<http://ftp.ncdc.noaa.gov|ftp.ncdc.noaa.gov>)... 205.167.25.137, 2610:20:8040:2::137                                  Connecting to <http://ftp.ncdc.noaa.gov|ftp.ncdc.noaa.gov> (<http://ftp.ncdc.noaa.gov|ftp.ncdc.noaa.gov>)|205.167.25.137|:21... connected.                                    Logging in as anonymous ... Logged in!                                                                                  ==> SYST ... done.    ==> PWD ... done.                                                                                 ==> TYPE I ... done.  ==> CWD (1) /pub/data/swdi/stormevents/csvfiles ... done.                                         ==> PASV ... done.    ==> LIST ... done.                                                                                                                                                                                                        <http://ftp.ncdc.noaa.gov/pub/data/sw|ftp.ncdc.noaa.gov/pub/data/sw>     [ <=>                                              ]  23.05K   140KB/s    in 0.2s                                                                                                                             2021-04-14 18:52:35 (140 KB/s) - '<http://ftp.ncdc.noaa.gov/pub/data/swdi/stormevents/csvfiles/.listing|ftp.ncdc.noaa.gov/pub/data/swdi/stormevents/csvfiles/.listing>' saved [23606]                                                                                                                                  No matches on pattern 'StormEvents_details-ftp_v1.0_*.csv.gz\r'.                                                        FINISHED --2021-04-14 18:52:35--                                                                                        Total wall clock time: 0.7s                                                                                             Downloaded: 1 files, 23K in 0.2s (140 KB/s)                                                                             : not foundport-storm-events.sh: 11: ./import/import-storm-events.sh:                                                   ./import/import-storm-events.sh: 15: ./import/import-storm-events.sh: Syntax error: word unexpected (expecting "do")
k
Can you take a screenshot of your terminal output and paste it here?
👍 1
h
Screenshot (115).png
k
Ah. This is a shell script. Which you can only run in a Unix/Linux environment. The Window terminal uses bat scripts, which is why it's not working.
👍 1
Windows does have a bash-based terminal
👍 1
Definitely a bummer trying to run this stuff and learn on Windows
🙏 1
But if you follow that guide, you'll be able to run shell scripts successfully
🙏 1
h
I will install WSL and start over. I did learn a lot today though 🙂 . Thanks again for your help. Just one last question. Would I be able to set everything up in Ubuntu ?
still having issues ☹️
Even though I installed everything
Hi @Kenny Bastani when click to view the Dashboards on Superset, It gives me Apache Pino Error {'errorCode': 410, 'message': 'BrokerResourceMissingError'} This may be triggered by: Issue 1002 - The database returned an unexpected error. Please reach out to the Chart Owners for assistance. Chart Owners:
Open in Slack
PreviousNext
Powered by