https://pinot.apache.org/ logo
Join Slack
Powered by
Did anyone ever had trouble building the docker im...
# troubleshooting
d
Did anyone ever had trouble building the docker images through the scripts like explained here in the docs? Every time I try to do that it fails while still downloading maven packages, but it does not give me a reason. And it always fails at a different moment - so not a problem from a specific repo or package. I'm suspecting the problem lies inside my own laptop, but I can't exactly figure out what. Example of the last time I tried running `docker-build.sh`:
Copy code
#13 256.9 Downloading from central: <https://repo.maven.apache.org/maven2/org/codehaus/groovy/groovy-all/2.4.21/groovy-all-2.4.21.jar>
Progress (4): 0.8/1.4 MB | 349 kB | 426/588 kB | 565/632 kB
#13 257.0 [output clipped, log limit 1MiB reached]
------
executor failed running [/bin/sh -c git clone ${PINOT_GIT_URL} ${PINOT_BUILD_DIR} &&     cd ${PINOT_BUILD_DIR} &&     git checkout ${PINOT_BRANCH} &&     mvn install package -DskipTests -Pbin-dist -Pbuild-shaded-jar -Dkafka.version=${KAFKA_VERSION} -Djdk.version=${JDK_VERSION} &&     mkdir -p ${PINOT_HOME}/configs &&     mkdir -p ${PINOT_HOME}/data &&     cp -r pinot-distribution/target/apache-pinot-*-bin/apache-pinot-*-bin/* ${PINOT_HOME}/. &&     chmod +x ${PINOT_HOME}/bin/*.sh]: exit code: 1
Now that I can see the logs, here is the real error:
Copy code
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] javac: invalid flag: --release
Usage: javac <options> <source files>
use -help for a list of possible options

[INFO] 1 error
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Pinot 0.9.3:
[INFO]
[INFO] Pinot .............................................. SUCCESS [03:33 min]
[INFO] Pinot Service Provider Interface ................... FAILURE [ 23.511 s]
[INFO] Pinot Segment Service Provider Interface ........... SKIPPED
[INFO] Pinot Plugins ...................................... SKIPPED
[INFO] Pinot Metrics ...................................... SKIPPED
[INFO] Pinot Yammer Metrics ............................... SKIPPED
[INFO] Pinot Common ....................................... SKIPPED
[INFO] Pinot Input Format ................................. SKIPPED
[INFO] Pinot Avro Base .................................... SKIPPED
[INFO] Pinot Avro ......................................... SKIPPED
[INFO] Pinot Csv .......................................... SKIPPED
[INFO] Pinot JSON ......................................... SKIPPED
[INFO] Pinot local segment implementations ................ SKIPPED
[INFO] Pinot Core ......................................... SKIPPED
[INFO] Pinot Server ....................................... SKIPPED
[INFO] Pinot Segment Uploader ............................. SKIPPED
[INFO] Pinot Segment Uploader Default ..................... SKIPPED
[INFO] Pinot Controller ................................... SKIPPED
[INFO] Pinot Broker ....................................... SKIPPED
[INFO] Pinot Clients ...................................... SKIPPED
[INFO] Pinot Java Client .................................. SKIPPED
[INFO] Pinot JDBC Client .................................. SKIPPED
[INFO] Pinot Batch Ingestion .............................. SKIPPED
[INFO] Pinot Batch Ingestion Common ....................... SKIPPED
[INFO] Pinot Minion ....................................... SKIPPED
[INFO] Pinot Confluent Avro ............................... SKIPPED
[INFO] Pinot ORC .......................................... SKIPPED
[INFO] Pinot Parquet ...................................... SKIPPED
[INFO] Pinot Thrift ....................................... SKIPPED
[INFO] Pinot Protocol Buffers ............................. SKIPPED
[INFO] Pluggable Pinot file system ........................ SKIPPED
[INFO] Pinot Azure Data Lake Storage ...................... SKIPPED
[INFO] Pinot Hadoop Filesystem ............................ SKIPPED
[INFO] Pinot Google Cloud Storage ......................... SKIPPED
[INFO] Pinot Amazon S3 .................................... SKIPPED
[INFO] Pinot Batch Ingestion for Spark .................... SKIPPED
[INFO] Pinot Batch Ingestion for Hadoop ................... SKIPPED
[INFO] Pinot Batch Ingestion Standalone ................... SKIPPED
[INFO] Pinot Batch Ingestion .............................. SKIPPED
[INFO] Pinot Ingestion Common ............................. SKIPPED
[INFO] Pinot Hadoop ....................................... SKIPPED
[INFO] Pinot Spark ........................................ SKIPPED
[INFO] Pinot Stream Ingestion ............................. SKIPPED
[INFO] Pinot Kafka Base ................................... SKIPPED
[INFO] Pinot Kafka 0.9 .................................... SKIPPED
[INFO] Pinot Kafka 2.0 .................................... SKIPPED
[INFO] Pinot Kinesis ...................................... SKIPPED
[INFO] Pinot Pulsar ....................................... SKIPPED
[INFO] Pinot Minion Tasks ................................. SKIPPED
[INFO] Pinot Minion Built-In Tasks ........................ SKIPPED
[INFO] Pinot Dropwizard Metrics ........................... SKIPPED
[INFO] Pinot Segment Writer ............................... SKIPPED
[INFO] Pinot Segment Writer File Based .................... SKIPPED
[INFO] Pluggable Pinot Environment Provider ............... SKIPPED
[INFO] Pinot Azure Environment ............................ SKIPPED
[INFO] Pinot Tools ........................................ SKIPPED
[INFO] Pinot Test Utils ................................... SKIPPED
[INFO] Pinot Integration Tests ............................ SKIPPED
[INFO] Pinot Perf ......................................... SKIPPED
[INFO] Pinot Distribution ................................. SKIPPED
[INFO] Pinot Connectors ................................... SKIPPED
[INFO] Pinot Spark Connector .............................. SKIPPED
[INFO] Presto Pinot Driver ................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  04:10 min
[INFO] Finished at: 2022-02-11T12:20:07Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile (default-compile) on project pinot-spi: Compilation failure
[ERROR] javac: invalid flag: --release
Looks like it is related to the Java version. I was just reading the official docs and I missed some extra info that we have on the code:
Copy code
```SHELL
./docker-build.sh [Docker Tag] [Git Branch] [Pinot Git URL] [Kafka Version] [Java Version]
This script will check out Pinot Repo 
[Pinot Git URL]
on branch 
[Git Branch]
and build the docker image for that. The docker image is tagged as 
[Docker Tag]
. `Docker Tag`: Name and tag your docker image. Default is 
pinot:latest
. `Git Branch`: The Pinot branch to build. Default is 
master
. `Pinot Git URL`: The Pinot Git Repo to build, users can set it to their own fork. Please note that, the URL is 
https://
based, not 
git://
. Default is the Apache Repo: 
<https://github.com/apache/incubator-pinot.git>
. `Kafka Version`: The Kafka Version to build pinot with. Default is 
2.0
`Java Version`: The Java Version to build pinot with. Default is `8````
r
i dont think the documentation is up to date. from checking the code the dfeault java verison in DockerFile is set to 11.
could you please share what host environment / docker version / docker desktop version you are running the docker build on?
d
I already found out the issue (note: I'm building 
0.9.3
): the build script falls back to Java 8 and the docs don't say you can change that (and of course reading the script itself was the last thing I did 😅 ) 
--release
don't work with Java 8. By reading the code I learned that I can set up the Java version I want to use - that info is also available in the README inside 
docker/images/pinot
😬 Then I ran the build script explicitly telling it to use Kafka 2.0 and Java 11 and it worked
🙌 1
r
sweet! thanks for the info. we should probably update the doc accordingly too. @Mark Needham ^ FYI
m
@Rong R where abouts do we need to update?
r
seems the doc here is what's being followed: https://docs.pinot.apache.org/operators/tutorials/build-docker-images I can create a PR today. can you help review/merge it? thanks
d
Thanks, folks 😄
👍 1
2 Views
Open in Slack
PreviousNext
Powered by