This message was deleted.
# generals
Slackbot
11/29/2023, 8:13 AMThis message was deleted.
s
Sergio Ferragut
11/29/2023, 6:41 PMI'm not familiar with Deb 11 DataProc, but could you provide more context for the error. Where and when do you see this error?
a
Amit Sharma
11/29/2023, 7:33 PMCurrent Scenario:
With Druid 22 version we are using Hadoop based ingestion for ingesting the data into Druid. For managing Hadoop cluster we are using DataProc (Managed service provided by Google, similar to Ambari/EMR) which provides Java 8 as default runtime environment.
Now we want to upgrade DataProc cluster with Deb 11 (Operating System) which provided Java 11 as default runtime environment. We are not allowed to installed multiple JRE also on this cluster, So when we are running our existing Druid Ingestion job into New cluster it was giving following exception:
Copy code
java.lang.ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLClassLoader (jdk.internal.loader.ClassLoaders$AppClassLoader and java.net.URLClassLoader are in module java.base of loader 'bootstrap')]Amit Sharma
11/29/2023, 8:50 PM@Sergio Ferragut FYI
s
Sergio Ferragut
11/29/2023, 9:52 PMI see. My first thought is that I don't think the release is supported with Java 11. Let me check on the Java support for Druid 22...
Sergio Ferragut
11/30/2023, 2:48 AMWhile this might not be the reason, Druid 24 is when Java 11 support was introduced. We are currently on Druid 28.0 which supports Java 17.
Sergio Ferragut
11/30/2023, 2:52 AMIf you end up upgrading Druid, you should look at the intervening releases' release notes for Upgrade Notes. Also of note is that Hadoop 2 support has been dropped. Hadoop 3 is still supported. Also new to you will be SQL Based ingestion which is how many Druid implementations are transforming the data at ingestion instead of Hadoop based preprocessing. Just trying to give you useful information, no pressure 😉
Sergio Ferragut
12/01/2023, 4:07 PMSome thoughts from more knowledgeable folks:
• the issue with "cannot cast to URLClassLoader" was fixed by https://github.com/apache/druid/pull/8392 in 0.16 for
index_hadoopjava org.apache.druid.cli.Main index hadoop <spec_file>a
Amit Sharma
12/07/2023, 6:23 AMsure will look into suggestions
Amit Sharma
12/07/2023, 6:24 AMYes most probably using Cli one class