Is there support for SSL connections to Kafka for the KafkaConsumer used by pinot? https://docs.pinot.apache.org/basics/data-import/pinot-stream-ingestion/import-from-apache-kafka I don’t see option to pass in keystore/truststore etc as part of the configuration?

@Pradeep Anything you put in streamConfigs with prefix

kafka.consumer.prop

will be used to create the kafkaconsumer

awesome thanks

something like this should work

kafka.consumer.prop.security.protocol=SSL
kafka.consumer.prop.ssl.truststore.location=/var/private/ssl/kafka.client.truststore.jks
kafka.consumer.prop.ssl.truststore.password=test1234
kafka.consumer.prop.ssl.keystore.location=/var/private/ssl/kafka.client.keystore.jks
kafka.consumer.prop.ssl.keystore.password=test1234
kafka.consumer.prop.ssl.key.password=test1234

@Neha Pawar @Subbu Subramaniam please confirm

no prefix needed. anything you put in the streamConfigs map should get passed on to the consumer

Properties consumerProp = new Properties();
    consumerProp.putAll(streamConfig.getStreamConfigsMap());
    _consumer = new KafkaConsumer<>(consumerProp);

nice, thanks