Hi, we're running Flink 1.18 and multiple session ...
# troubleshooting
g
Hi, we're running Flink 1.18 and multiple session clusters with many jobs in them. We enabled autoscaler on the cluster and have started seeing this runtime exception that wasn't happening before:
Copy code
Caused by: java.lang.NoClassDefFoundError: org/apache/kafka/common/security/scram/internals/ScramSaslClient
	at org.apache.kafka.common.security.scram.internals.ScramSaslClient$ScramSaslClientFactory.createSaslClient(ScramSaslClient.java:236)
	at java.security.sasl/javax.security.sasl.Sasl.createSaslClient(Unknown Source)
	at org.apache.kafka.common.security.authenticator.SaslClientAuthenticator.lambda$createSaslClient$0(SaslClientAuthenticator.java:219)
	at java.base/java.security.AccessController.doPrivileged(Native Method)
	at java.base/javax.security.auth.Subject.doAs(Unknown Source)
I think it is the Flink classloader doing something that causes this to happen - I checked my maven dependency tree and it all looks good. It does contain the kafka client library as part of it. Any pointers on how we can solve this?
Copy code
dependency
      groupIdorg.apache.flink/groupId
      artifactIdflink-connector-kafka/artifactId
      version3.2.0-1.18/version
    /dependency

    <!-- https://mvnrepository.com/artifact/org.apache.flink/flink-connector-base -->
    dependency
      groupIdorg.apache.flink/groupId
      artifactIdflink-connector-base/artifactId
      version1.18.0/version
    /dependency
    dependency
      groupIdorg.apache.kafka/groupId
      artifactIdkafka-clients/artifactId
      version3.2.3/version
    /dependency
Above are the dependencies I have in my pom.xml
Bumping this up. Can someone please help here? This is causing a lot of our production pipelines to go down randomly for no reason.
🚨 1
b
Out of interest, why are you running multiple session clusters?
g
We have divided clusters based on use-case. Each cluster of jobs has their own purpose and managing N clusters would be difficult if we went with a
cluster per job
model