https://pinot.apache.org/ logo
Join Slack
Powered by
Hi folks I am trying to build a docker image from ...
# general
p
Hi folks I am trying to build a docker image from the source as:
Copy code
./docker-build.sh pinot:new-range-index master <https://github.com/apache/incubator-pinot.git>
This gives me an error:
Copy code
executor failed running [/bin/sh -c git clone ${PINOT_GIT_URL} ${PINOT_BUILD_DIR} &&     cd ${PINOT_BUILD_DIR} &&     git checkout ${PINOT_BRANCH} &&     mvn install package -DskipTests -Pbin-dist -Pbuild-shaded-jar -Dkafka.version=${KAFKA_VERSION} -Djdk.version=${JDK_VERSION} &&     mkdir -p ${PINOT_HOME}/configs &&     mkdir -p ${PINOT_HOME}/data &&     cp -r pinot-distribution/target/apache-pinot-*-bin/apache-pinot-*-bin/* ${PINOT_HOME}/. &&     chmod +x ${PINOT_HOME}/bin/*.sh]: exit code: 1
Anything that I need to do/configure to fix this?
x
Can you try:
Copy code
./docker-build.sh pinot:new-range-index master <https://github.com/apache/incubator-pinot.git> 2.0 11
seems jdk8 build has some issue, will try to fix that
p
It’s building, will update if this works. Thanks @User
x
or you can manually set the JDK image to jdk 11 to build with jdk8
In short this is just a wrapper script on top of
Copy code
docker build --no-cache -t ${DOCKER_TAG} --build-arg PINOT_BRANCH=${PINOT_BRANCH} --build-arg PINOT_GIT_URL=${PINOT_GIT_URL} --build-arg KAFKA_VERSION=${KAFKA_VERSION} --build-arg JAVA_VERSION=${JAVA_VERSION} -f Dockerfile .
You can set it by yourself
and modify Dockerfile accordingly 😛
p
Hey @User specifying java version to 11 is giving me the same error. Were you able to run it?
x
Hmm do you have full log
j
I tried reproducing the issue on my local with(./docker-build.sh pinot:new-range-index master https://github.com/apache/incubator-pinot.git) . It’s occurring, due to the reaching docker log limit 
1MiB
. This issue may hit with jdk8 or jdk11. Useful logs of the run :
Copy code
./docker-build.sh pinot:new-range-index master <https://github.com/apache/incubator-pinot.git>

Trying to build Pinot docker image from Git URL: [ <https://github.com/apache/incubator-pinot.git> ] on branch: [ master ] and tag it as: [ pinot:new-range-index ]. Kafka Dependencies: [ 2.0 ]. Java Version: [ 8 ].

#12 683.4 [INFO] 
#12 683.4 [INFO] --- jacoco-maven-plugin:0.8.6:prepare-agent (default) @ pinot ---
#12 683.4 [INFO] argLine set to -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.agent/0.8.6/org.jacoco.agent-0.8.6-runtime.jar=destfile=/opt/pinot-build/target/jacoco.exec -Xms4g -Xmx4g
#12 683.4 [INFO] 
#12 683.4 [INFO] --- maven-remote-resources-plugin:1.6.0:process (process-resource-bundles) @ pinot ---
#12 683.4 [INFO] Preparing remote bundle org.apache:apache-jar-resource-bundle:1.4
#12 683.4 [INFO] Copying 3 resources from 1 bundle.
#12 683.4 [INFO] 
#12 683.4 [INFO] --- maven-remote-resources-plugin:1.6.0:process (default) @ pinot ---
#12 683.4 [INFO] Preparing remote bundle org.apache:apache-jar-resource-bundle:1.4
#12 683.4 [INFO] Copying 3 resources from 1 bundle.
#12 683.4 [INFO] 
#12 683.4 [INFO] --- jacoco-maven-plugin:0.8.6:report-aggregate (report) @ pinot ---
#12 683.5 [INFO] 
#12 683.5 [INFO] --- maven-site-plugin:3.7.1:attach-descriptor (attach-descriptor) @ pinot ---
#12 683.5 [INFO] No site descriptor found: nothing to attach.
#12 683.5 [INFO] 
#12 683.5 [INFO] ---------------------< org.apache.pinot:pinot-spi >---------------------
#12 683.5 [INFO] Building Pinot Service Provider Interface 0.9.0-SNAPSHOT          [2/63]
#12 683.5 [INFO] --------------------------------[ jar ]---------------------------------
#12 683.5 Downloading from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.2.0/maven-jar-plugin-3.2.0.pom>
Downloaded from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.2.0/maven-jar-plugin-3.2.0.pom> (7.3 kB at 18 kB/s)
#12 683.9 Downloading from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.2.0/maven-jar-plugin-3.2.0.jar>
Downloaded from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.2.0/maven-jar-plugin-3.2.0.jar> (29 kB at 67 kB/s)
#12 684.3 Downloading from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/2.6/maven-resources-plugin-2.6.pom>
Downloaded from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/2.6/maven-resources-plugin-2.6.pom> (8.1 kB at 20 kB/s)
#12 684.7 Downloading from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/23/maven-plugins-23.pom>
Downloaded from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/23/maven-plugins-23.pom> (9.2 kB at 24 kB/s)
#12 685.1 Downloading from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/2.6/maven-resources-plugin-2.6.jar>
Downloaded from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/2.6/maven-resources-plugin-2.6.jar> (30 kB at 70 kB/s)
#12 685.6 Downloading from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.8.0/maven-compiler-plugin-3.8.0.pom>
Downloaded from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.8.0/maven-compiler-plugin-3.8.0.pom> (12 kB at 32 kB/s)
#12 685.9 Downloading from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/32/maven-plugins-32.pom>
Downloaded from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/32/maven-plugins-32.pom> (11 kB at 28 kB/s)
#12 686.3 Downloading from central: <https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/32/maven-parent-32.pom>
Downloaded from central: <https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/32/maven-parent-32.pom> (43 kB at 100 kB/s)
#12 686.8 Downloading from central: <https://repo.maven.apache.org/maven2/org/apache/apache/20/apache-20.pom>
Downloaded from central: <https://repo.maven.apache.org/maven2/org/apache/apache/20/apache-20.pom> (16 kB at 38 kB/s)
#12 687.2 Downloading from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.8.0/maven-compiler-plugin-3.8.0.jar>
Downloaded from central: <https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.8.0/maven-compiler-plugin-3.8.0.jar> (62 kB at 49 kB/s)
#12 688.4 Downloading from central: http
#12 688.4 [output clipped, log limit 1MiB reached]

#12 ERROR: executor failed running [/bin/sh -c git clone ${PINOT_GIT_URL} ${PINOT_BUILD_DIR} &&     cd ${PINOT_BUILD_DIR} &&     git checkout ${PINOT_BRANCH} &&     mvn install package -DskipTests -Pbin-dist -Pbuild-shaded-jar -Dkafka.version=${KAFKA_VERSION} -Djdk.version=${JDK_VERSION} &&     mkdir -p ${PINOT_HOME}/configs &&     mkdir -p ${PINOT_HOME}/data &&     cp -r pinot-distribution/target/apache-pinot-*-bin/apache-pinot-*-bin/* ${PINOT_HOME}/. &&     chmod +x ${PINOT_HOME}/bin/*.sh]: exit code: 1
------
@User, you could use below link to set log limit at global level of docker and build the image : https://github.com/docker/buildx/issues/484#issuecomment-767434491
@User, if we are trying to build Pinot image locally for testing purpose, is it a good idea to make docker build to first look into the jar’s present locally(
${Home}/.m2/repository
and later fire https request to the maven central. This may help in quicker build of the image.
Open in Slack
PreviousNext
Powered by