Hello - I need to build pinot v0.11.0 from source ...
# troubleshooting
a
Hello - I need to build pinot v0.11.0 from source using JDK8 for the ingestion job on our EMR cluster. error:
Copy code
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile (default-compile) on project pinot-fmpp-maven-plugin: Compilation failure -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile (default-compile) on project pinot-fmpp-maven-plugin: Compilation failure
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:215)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call (MultiThreadedBuilder.java:200)
    at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call (MultiThreadedBuilder.java:196)
    at java.util.concurrent.FutureTask.run (FutureTask.java:266)
    at java.util.concurrent.Executors$RunnableAdapter.call (Executors.java:511)
    at java.util.concurrent.FutureTask.run (FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:624)
    at java.lang.Thread.run (Thread.java:750)
Caused by: org.apache.maven.plugin.compiler.CompilationFailureException: Compilation failure
    at org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute (AbstractCompilerMojo.java:1219)
    at org.apache.maven.plugin.compiler.CompilerMojo.execute (CompilerMojo.java:188)
    at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
    at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
    at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
    at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call (MultiThreadedBuilder.java:200)
    at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call (MultiThreadedBuilder.java:196)
    at java.util.concurrent.FutureTask.run (FutureTask.java:266)
    at java.util.concurrent.Executors$RunnableAdapter.call (Executors.java:511)
    at java.util.concurrent.FutureTask.run (FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:624)
    at java.lang.Thread.run (Thread.java:750)
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] <http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException>
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :pinot-fmpp-maven-plugin
environment:
Copy code
openjdk version "11.0.16" 2022-07-19
OpenJDK Runtime Environment (build 11.0.16+8-post-Ubuntu-0ubuntu118.04)
OpenJDK 64-Bit Server VM (build 11.0.16+8-post-Ubuntu-0ubuntu118.04, mixed mode, sharing) Maven home: /usr/share/maven

Java version: 11.0.16, vendor: Ubuntu, runtime: /usr/lib/jvm/java-11-openjdk-amd64
Default locale: en, platform encoding: UTF-8
OS name: "linux", version: "5.4.0-1088-aws", arch: "amd64", family: "unix"
build command:
Copy code
mvn clean install -DskipTests -Pbin-dist -T 4  -Djdk.version=8 -X
--- <edited to remove mvn version troubleshooting that was a red herring> I've tested compiling for both java8 and java11 at this point and always receiving the same error. Makes me think there is something wrong with the fmpp plugin, but I'm struggling to get past this since I'm lacking in java experience.
Update: I was able to resolve the first error by doing a full install of open-jdk. I noticed this needed to be done after seeing that
javac -version
threw an error. After that I am now seeing
Copy code
[ERROR] Failed to parse plugin descriptor for org.apache.pinot:pinot-fmpp-maven-plugin:0.11.0 (/home/andrew.cooper/pinot/contrib/pinot-fmpp-maven-plugin/target/classes): No plugin descriptor found at META-INF/maven/plugin.xml -> [Help 1]
org.apache.maven.plugin.PluginDescriptorParsingException: Failed to parse plugin descriptor for org.apache.pinot:pinot-fmpp-maven-plugin:0.11.0 (/home/andrew.cooper/pinot/contrib/pinot-fmpp-maven-plugin/target/classes): No plugin descriptor found at META-INF/maven/plugin.xml
    at org.apache.maven.plugin.internal.DefaultMavenPluginManager.extractPluginDescriptor (DefaultMavenPluginManager.java:241)
Going to pick this back up tomorrow, but would love to know if anyone has an easy fix for this latest error.
m
@Kartik Khare can you take a look?
Or @Rong R
r
Can you try using the jdk8 profile as well?
https://github.com/apache/pinot/blob/master/.github/workflows/scripts/.pinot_quickstart.sh#L73 based on this it seems like it should work without any problem
x
Copy code
mvn clean install -DskipTests -Pbin-dist  -Djdk.version=8 -X
can you try to not build modules in parallel
pinot is building the jdk8 modules, which has the hyperlink to the original directory. So if they are building together, then there could be some conflict
👍 1
a
Thank you - remove the
-T
allowed for this to go through.
My initial issues were related to openjdk. an install of jdk11 fixed this issues.
x
Got it, with jdk11(luckily it’s compatible with lower version), you can still build jdk8 modules, just don’t set -T :p