I recall Flink requiring a specific version

Hrm, it looks like the

flink-clients

dependency seems to bring in a

commons-cli:commons-cli

- maybe that’s related?

Not seeing anything that explicitly jumps out as the Janino one that’s being compiled in.

So - not seeing any dependencies via the

dependency:tree

to Janino anywhere.

I also see the org.codehaus.commons ones too:

But I’m not familiar enough with that’s going to to know if both of those should be excluded or just the janino one?

Looking at the External Libraries references in the Maven project, I do see two separate versions of those related libraries being referenced which may/may not be a problem:

And each individual job is a child from the base pom. Only the job that relies on the Table API appears to have this problem though.

(similar to the Immerok example in the original post)

for Flink 1.18.0 there should be 3.1.10

Specifically a non-Flink dependency with the compile scope that’s packaging this into the jar.

Although I suppose I could add this as an exclude in the artifact set for the maven-shade-plugin for this particular job as well. I’d imagine that would work?

Similar to what is done with things like these:

<artifactSet>
    <excludes>
        <exclude>org.apache.flink:flink-shaded-force-shading</exclude>
        <exclude>com.google.code.findbugs:jsr305</exclude>
        <exclude>org.slf4j:*</exclude>
        <exclude>org.apache.logging.log4j:*</exclude>
    </excludes>
</artifactSet>

Additionally I verified that the following dependencies are not present/included within this particular. These are both brought in in other modules, none of which are referenced by this specific Flink job/pom:

The larger stacktrace looks like:

Application failed unexpectedly: java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
	at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_345]
	at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_345]
	at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_345]
	at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_345]
	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_345]
	at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_345] 
...
Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Unable to instantiate java compiler
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372) ~[flink-dist-1.15.2-stream3.jar:1.15.2-stream3]
...
Caused by: java.lang.IllegalStateException: Unable to instantiate java compiler
	at org.apache.calcite.rel.metadata.JaninoRelMetadataProvider.compile(JaninoRelMetadataProvider.java:428) ~[?:?]
...
Caused by: java.lang.ClassCastException: org.codehaus.janino.CompilerFactory cannot be cast to org.codehaus.commons.compiler.ICompilerFactory
	at org.codehaus.commons.compiler.CompilerFactoryFactory.getCompilerFactory(CompilerFactoryFactory.java:129) ~[flink-table-runtime-1.15.2-stream3.jar:1.15.2-stream3]
...

which sounds like more of a missing dependency problem

I was assuming based on the Immerok example POM that the only dependencies I needed related to table api were the ones defined in there (all of which are present). Is it possible there’s some additional ones that I might need?

As far as dependencies in this particular troublesome job, there’s:

<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-table-api-java-bridge</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-table-planner-loader</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-table-runtime</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-base</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-json</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-elasticsearch7</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-avro-confluent-registry</artifactId>
    <version>${flink.version}</version>
</dependency>

Just following up on this again. Still experiencing the same issue as prior and I believe it’s likely related to some of the dependencies either not being explicitly compiled or too many conflicting ones in the same jar that’s being executed. Image-wise, we’re using the Flink image from Ververica Platform (in the process of migrating to the operator soon), which should be specifically the

1.15.2-stream3-scala_2.12-java8

image, which has previously worked as expected however the project was recently moved to a different directory with a parent pom and cleaned up, the only major changes were migrating from the following dependencies:

<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-java</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-table-api-java-bridge</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-table-planner_${scala.binary.version}</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-scala_${scala.binary.version}</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>

to the dependencies that were shared above (non explicit Scala versioned ones). I’m unsure if some of the newer ones need to be explicitly declared as compile scope or if there’s another issue at play.

Ugh, I just realized the older project was explicitly being compiled against 1.8 and the new project targets 11. Which would make sense as to why the issue would be compiler-specific, going to try bumping the image to use the java11 one instead of the java8 one.

Attempted running the job against the Java11 image and it had the same exception with slightly more detail:

Caused by: java.lang.ClassCastException: class org.codehaus.janino.CompilerFactory cannot be cast to class org.codehaus.commons.compiler.ICompilerFactory (org.codehaus.janino.CompilerFactory is in unnamed module of loader org.apache.flink.util.ChildFirstClassLoader @6dab9b6d; org.codehaus.commons.compiler.ICompilerFactory is in unnamed module of loader 'app')

The above worked originally, however after migrating the project over to use the parent POM I haven’t been able to get it to work targeting 11. I’ve updated the Flink image to use the

-java11

variant instead of the

-java8

one, updated all of the dependencies to match those defined earlier and in the Immerok Table API example, but have continually fought this error on any attempts to run against 11.

if i understand correctly your poms this is removed from the final version

then at least the correct janino dependency shold be specified, may be something else, that i don't know

So I tried reverting back to the older dependencies and targeting 1.8 and got a few errors related to the planner, namely:

Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Could not instantiate the executor. Make sure a planner module is on the classpath
...
Caused by: org.apache.flink.table.api.ValidationException: Multiple factories for identifier 'default' that implement 'org.apache.flink.table.delegation.ExecutorFactory' found in the classpath.

Ambiguous factory classes are:

org.apache.flink.table.planner.delegation.DefaultExecutorFactory
org.apache.flink.table.planner.loader.DelegateExecutorFactory

These are the dependencies that job was using:

<dependency>
            <groupId>org.apache.flink</groupId>
            <artifactId>flink-streaming-java</artifactId>
            <version>${flink.version}</version>
            <scope>${flink.scope}</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.flink</groupId>
            <artifactId>flink-java</artifactId>
            <version>${flink.version}</version>
            <scope>${flink.scope}</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.flink</groupId>
            <artifactId>flink-clients</artifactId>
            <version>${flink.version}</version>
            <scope>${flink.scope}</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.flink</groupId>
            <artifactId>flink-table-api-java-bridge</artifactId>
            <version>${flink.version}</version>
            <scope>${flink.scope}</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.flink</groupId>
            <artifactId>flink-table-planner_2.12</artifactId>
            <version>${flink.version}</version>
            <scope>compile</scope>
            <exclusions>
                <exclusion>
                    <groupId>org.apache.flink</groupId>
                    <artifactId>flink-table-runtime</artifactId>
                </exclusion>
                <exclusion>
                    <groupId>org.apache.flink</groupId>
                    <artifactId>flink-scala_2.12</artifactId>
                </exclusion>
            </exclusions>
        </dependency>

I had to do some exclusions due to the maven-enforce plugin that was catching multiple dependencies

So it doesn’t seem to work with the dependencies that it did prior (maven-enforce picks out duplicate classes from the planner dependency) and the latter (Immerok example) results in the unable to instantiate java compiler error.

Still continuing to troubleshoot this and I managed to remove any additional Flink dependencies in the parent POM, so the only Flink dependencies that I can see are the following:

<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-streaming-java</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-clients</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-table-api-java-bridge</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-table-planner-loader</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-table-runtime</artifactId>
    <version>${flink.version}</version>
    <scope>${flink.scope}</scope>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-kafka</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-base</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-json</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-connector-elasticsearch7</artifactId>
    <version>${flink.version}</version>
</dependency>
<dependency>
    <groupId>org.apache.flink</groupId>
    <artifactId>flink-avro-confluent-registry</artifactId>
    <version>${flink.version}</version>
</dependency>

And all of the instances of

flink.scope

are replaced with

provided

when building the jars (they use

compile

for running/testing in the IDE). As mentioned before the image being used behind the scenes would be Ververica Platform’s v2.8 (

1.15.2-stream4-scala_2.12-java8

). But based on the error message that I’m seeing in the logs, it looks like it’s referencing the table-api-uber jar behind the scenes:

Caused by: java.lang.ClassCastException: org.codehaus.janino.CompilerFactory cannot be cast to org.codehaus.commons.compiler.ICompilerFactory
	at org.codehaus.commons.compiler.CompilerFactoryFactory.getCompilerFactory(CompilerFactoryFactory.java:129) ~[flink-table-runtime-1.15.2-stream3.jar:1.15.2-stream3]
	at org.codehaus.commons.compiler.CompilerFactoryFactory.getDefaultCompilerFactory(CompilerFactoryFactory.java:79) ~[flink-table-runtime-1.15.2-stream3.jar:1.15.2-stream3]
...
[flink-table-api-java-uber-1.15.2-stream3.jar:1.15.2-stream3]

However, since all of my Flink-related dependencies use provided, I’m not entirely sure how I’d be getting a conflict.

The

org.codehaus.janino.CompilerFactory cannot be cast to org.codehaus.commons.compiler.ICompilerFactory

certainly makes it seem as though an extra dependency is in there that shouldn’t be though.

@Sergey Nuyanzin / @Martijn Visser After fighting with this for too many days, I eventually added the following configuration in as a last ditch effort and it appeared to work after stumbling upon it via the docs and archived mailing list:

classloader.resolve-order: parent-first

Just wanted to close the loop here, thanks to you both for helping fight this.