Hi, We are stuck with an issue in Prod. Looking fo...
# troubleshooting
a
Hi, We are stuck with an issue in Prod. Looking for some help We have deployed our jobs to Prod, after few days of running fine there are messages within the task managers. We are using Flink-1.19.1 version. Caused by: org.apache.kafka.common.KafkaException: org.apache.kafka.common.errors.SaslAuthenticationException: Failed to configure SaslClientAuthenticator at org.apache.kafka.common.network.SaslChannelBuilder.buildChannel(SaslChannelBuilder.java:239) ~[blob_p-9e25664f4ca681f1d296962c786fde4d6730853c-cad3a6b292deabbb14c46b1724c86b6c:?] at org.apache.kafka.common.network.Selector.buildAndAttachKafkaChannel(Selector.java:338) ~[blob_p-9e25664f4ca681f1d296962c786fde4d6730853c-cad3a6b292deabbb14c46b1724c86b6c:?] ... 14 more Caused by: org.apache.kafka.common.errors.SaslAuthenticationException: Failed to configure SaslClientAuthenticator Caused by: java.lang.IllegalArgumentException: Callback handler must be castable to org.apache.kafka.common.security.auth.AuthenticateCallbackHandler: org.apache.kafka.common.security.oauthbearer.internals.OAuthBearerSaslClientCallbackHandler at org.apache.kafka.common.security.oauthbearer.internals.OAuthBearerSaslClient$OAuthBearerSaslClientFactory.createSaslClient(OAuthBearerSaslClient.java:182) ~[blob_p-9e25664f4ca681f1d296962c786fde4d6730853c-cad3a6b292deabbb14c46b1724c86b6c:?] at javax.security.sasl.Sasl.createSaslClient(Unknown Source) ~[?:?]
v
If you're using Managed kafka service (MSK), switch to SCRAM based authentication.
Also check the disk usage of the Kafka
a
We are using Azure Eventhubs to consume the data from
Copy code
KafkaSource<String> seqsource = KafkaSource.<String>builder()
        .setBootstrapServers(System.getenv("SEQ_EVENTHUB_HOSTNAME") + ":9093")
        .setTopics(System.getenv("SEQ_EVENTHUB_NAME"))
        .setGroupId(System.getenv("SEQ_EVENTHUB_GROUP_NAME"))
        .setStartingOffsets(OffsetsInitializer.latest())
        .setValueOnlyDeserializer(new SimpleStringSchema())
        .setProperty("security.protocol", "SASL_SSL")
        .setProperty("sasl.mechanism", "OAUTHBEARER")
        .setProperty("sasl.jaas.config", "org.apache.kafka.common.security.oauthbearer.OAuthBearerLoginModule required;")
        .setProperty("sasl.login.callback.handler.class", "com.abc.round.auth.CManagedIdentityAuthCallbackHandler"+"Seq")
        .setProperty("retry.backoff.ms", "100")
        .setProperty("max.in.flight.requests.per.connection", "1")
        .setProperty("request.timeout.ms", "30000")
        .setProperty("retries", "10")
        .build();