Hi, has anyone tried Luna Streaming from DataStax? I’m trying their StarLight for Kafka to test replacing our Kafka instance with Pulsar as a PoC https://docs.datastax.com/en/streaming/luna-streaming/2.10-3.x/components/starlight-for-kafka.html I’ve deployed the Pulsar in our AWS EKS and using the pulsar broker service name to connect to Pulsar using Kafka APIs. I’m able to create topic using kafka-topics.sh and use the kafka-console-producer and kafka-console-consumer to publish/consume messages. But alter config is not working. Anyone know about this error?

/usr/share/kafka-3.6.1/bin/kafka-configs.sh --bootstrap-server pulsar-broker.datastax-pulsar.svc.cluster.local:9092 --alter --topic 60d31fd3-0aa7-4302-bad4-95247aaa0646.sample.topic.name --add-config <http://retention.ms|retention.ms>=3600000
Error while executing config command with args '--bootstrap-server pulsar-broker.datastax-pulsar.svc.cluster.local:9092 --alter --topic 60d31fd3-0aa7-4302-bad4-95247aaa0646.sample.topic.name --add-config <http://retention.ms|retention.ms>=3600000'
java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.UnsupportedVersionException: The broker does not support INCREMENTAL_ALTER_CONFIGS
	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2022)
	at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:180)
	at kafka.admin.ConfigCommand$.alterConfig(ConfigCommand.scala:361)
	at kafka.admin.ConfigCommand$.processCommand(ConfigCommand.scala:328)
	at kafka.admin.ConfigCommand$.main(ConfigCommand.scala:97)
	at kafka.admin.ConfigCommand.main(ConfigCommand.scala)
Caused by: org.apache.kafka.common.errors.UnsupportedVersionException: The broker does not support INCREMENTAL_ALTER_CONFIGS

@David K do you have any insight here?

Starlight for Kafka may not support Kafka 3.6.1 yet - See https://github.com/datastax/starlight-for-kafka/blob/2.10_ds/pom.xml#L49

Is updating the kafka version in pom.xml all that would be required? I could make a PR if there’s any documentation on contributing/testing?

@Nicoló Boschi what do you think?