Hello people 👋🏻 I am trying to set up

kafka

as a destination locally and I am using our staging kafka confluent cluster, I am using

SASL_SSL

protocol as plain mechanism specifying the jaas config which has

org.apache.kafka.common.security.plain.PlainLoginModule required username="my_user" password="my_password";

But I am not able to have the connection working and seeing this as failure log

2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - org.apache.kafka.common.KafkaException: Failed to construct kafka producer
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:440) ~[kafka-clients-2.8.0.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:291) ~[kafka-clients-2.8.0.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:274) ~[kafka-clients-2.8.0.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.kafka.KafkaDestinationConfig.buildKafkaProducer(KafkaDestinationConfig.java:76) ~[io.airbyte.airbyte-integrations.connectors-destination-kafka-0.39.20-alpha.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.kafka.KafkaDestinationConfig.<init>(KafkaDestinationConfig.java:32) ~[io.airbyte.airbyte-integrations.connectors-destination-kafka-0.39.20-alpha.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.kafka.KafkaDestinationConfig.getKafkaDestinationConfig(KafkaDestinationConfig.java:38) ~[io.airbyte.airbyte-integrations.connectors-destination-kafka-0.39.20-alpha.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.kafka.KafkaDestination.check(KafkaDestination.java:48) [io.airbyte.airbyte-integrations.connectors-destination-kafka-0.39.20-alpha.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:140) [io.airbyte.airbyte-integrations.bases-base-java-0.39.20-alpha.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:107) [io.airbyte.airbyte-integrations.bases-base-java-0.39.20-alpha.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.destination.kafka.KafkaDestination.main(KafkaDestination.java:85) [io.airbyte.airbyte-integrations.connectors-destination-kafka-0.39.20-alpha.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - Caused by: java.lang.IllegalArgumentException: Could not find a 'KafkaClient' entry in the JAAS configuration. System property 'java.security.auth.login.config' is not set
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at org.apache.kafka.common.security.JaasContext.defaultContext(JaasContext.java:131) ~[kafka-clients-2.8.0.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at org.apache.kafka.common.security.JaasContext.load(JaasContext.java:96) ~[kafka-clients-2.8.0.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at org.apache.kafka.common.security.JaasContext.loadClientContext(JaasContext.java:82) ~[kafka-clients-2.8.0.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:167) ~[kafka-clients-2.8.0.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:81) ~[kafka-clients-2.8.0.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:105) ~[kafka-clients-2.8.0.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at org.apache.kafka.clients.producer.KafkaProducer.newSender(KafkaProducer.java:448) ~[kafka-clients-2.8.0.jar:?]
2022-07-12 09:37:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:429) ~[kafka-clients-2.8.0.jar:?]

Any idea please what I am missing here?

I’m getting the same issue.

k.KafkaDestinationConfig(propertiesByProtocol):81 - Kafka protocol config: {"security_protocol":"SASL_SSL","sasl_mechanism":"PLAIN","sasl_jaas_config":""}

Seems that the sasl_jaas_config is not set based on what I’m passing in the conf.