This message was deleted.

in middleManager log getting:

2023-06-14T01:25:12,327 WARN [DataStreamer for file /druid/task-logs/index_kafka_.LOGGING _3d968870f9eb302_phgoknak] org.apache.hadoop.hdfs.DataStreamer - DataStreamer Exception
java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()'

Hi @Oleg Yamin is this issue fixed i am also facing this while running

index_hadoop

with s3 storage

@Krishna well with HDFS we are stuck with java 8.. cuz hdfs libraries only work on java 8... so i have to roll back to that version. But with S3.... you need to add to jvm config

--add-exports=java.base/jdk.internal.misc=ALL-UNNAMED \
--add-exports=java.base/jdk.internal.ref=ALL-UNNAMED \
--add-opens=java.base/java.nio=ALL-UNNAMED \
--add-opens=java.base/sun.nio.ch=ALL-UNNAMED \
--add-opens=java.base/jdk.internal.ref=ALL-UNNAMED \
--add-opens=java.base/java.io=ALL-UNNAMED \
--add-opens=java.base/java.lang=ALL-UNNAMED \
--add-opens=jdk.management/com.sun.management.internal=ALL-UNNAMED

Or upgrade to druid 27+ since thats when they fully support it https://github.com/apache/druid/releases#27.0.0-highlights-java-17-support

Ok thank you we are Druid 25

then yeah.. add these options to jvm config in middlemanager and restart and that should resolve that error

Ok sure thank you

you can read about these options here: https://druid.apache.org/docs/25.0.0/operations/java.html#strong-encapsulation