pulsar

Can you share your KoP configuration? And do you try to use pulsar client to produce and consume?

upgrading the java version to 17 and using 2.10.3.1 version of pulsar and kop, I was able to produce to the cluster. But I am unable to consume from the topic using the kafka cmd line client. Getting  error with coordinator

05:56:55.093 [pulsar-client-io-43-1] ERROR io.streamnative.pulsar.handlers.kop.KafkaRequestHandler - [[id: 0x1e2f7c8b, L:/broker:9092 - R:/&lt;clientIP&gt;:41810]] Request RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=2, clientId=consumer-sub-1, correlationId=2215): Error while find coordinator.

Used these configs in the broker

```messagingProtocols=kafka
protocolHandlerDirectory=./protocols
allowAutoTopicCreationType=partitioned
narExtractionDirectory=/tmp
kafkaListeners=<PLAINTEXT://0.0.0.0:9092>
brokerEntryMetadataInterceptors=org.apache.pulsar.common.intercept.AppendIndexMetadataInterceptor
brokerDeleteInactiveTopicsEnabled=false
kafkaTransactionCoordinatorEnabled=true```


I have tried and tested KoP locally using these version and they worked flawlessly :
Pulsar Client : `2.8.2`
Kafka Client : `2.13_3.2.1`
KoP nar : `2.8.0.1` 

Configuration on broker.conf:
```
#environment-variables passed for enabling KoP plugin handler
messagingProtocols=kafka
kafkaListeners=<PLAINTEXT://127.0.0.1:9092>
kafkaAdvertisedListeners=<PLAINTEXT://127.0.0.1:9092>
protocolHandlerDirectory=./protocols
brokerEntryMetadataInterceptors=org.apache.pulsar.common.intercept.AppendIndexMetadataInterceptor
kafkaTransactionCoordinatorEnabled=true
entryFormat=pulsar```


hey thanks for the reply, it worked with standalone for me too, but was not working in the actual cluster setup.

<@U044WJQPRR6> Did you use `ns-isolation-policy` in the current cluster?

yes we do use `ns-isolation-policy` for my POC I have had just one broker though

Can you temporarily remove the `ns-isolation-policy` setting and see if the consumer works?

oh right i remember, in prod environment, even we had to set the isolation policyh

You can build a new docker image and add the file

I usually I have in my build pipeline a step that picks the standard Pulsar docker image and then adds some protocol handlers and additional connectors

<@U04MGMDQRMF>, here is an example of what Enrico suggested. A quick and easy way to get started with KoP on docker.

The consumer lag should be retrieved by external monitor tools like `kafka-exporter`.

Since I didn't login the slack for some days. I think you can open a GitHub issue if there was no answer here.

pulsar schema is not compatible to kafka schema server yet.  from the description, you are not using kop, but kafka source connector.  They are different.

I am using KoP so that I can use the Kafka Source Connector, because currently the Kafka Connect Adaptor doesn’t work for the database connector that I need (Yugabyte using Debezium). I am using KoP to write to Pulsar Topics using the Kafka Source Connector

Is there a way for me to use Pulsar Schema Registry in this setup?

<https://www.linkedin.com/posts/streamnative_decoding-kafka-challenges-activity-7163638039284572160-PmVj/?utm_source=share&amp;utm_medium=member_ios>

<https://www.linkedin.com/posts/streamnative_whitepaper-decoding-kafka-challenges-addressing-activity-7166454095246032897-FM1K?utm_source=share&amp;utm_medium=member_desktop|https://www.linkedin.com/posts/streamnative_whitepaper-decoding-kafka-challenges-addr[…]095246032897-FM1K?utm_source=share&amp;utm_medium=member_desktop>

<https://streamnative.io/blog/optimize-and-scale-how-kafka-on-streamnative-transforms-your-data-streaming-platform?utm_content=286059158&amp;utm_medium=social&amp;utm_source=linkedin&amp;hss_channel=lcp-20281744|https://streamnative.io/blog/optimize-and-scale-how-kafka-on-streamnative-transforms[…]tm_medium=social&amp;utm_source=linkedin&amp;hss_channel=lcp-20281744>

Do we have separate social media content for just the webinar? I will share it on LinkedIn, X, etc.

<https://streamnative.zoom.us/webinar/register/WN_bvm7kfvwTKGTBIxlHuiCvA#/registration>

<https://www.linkedin.com/posts/streamnative_welcome-you-are-invited-to-join-a-webinar-activity-7175528884086423552-y8gp/?utm_source=share&amp;utm_medium=member_desktop|https://www.linkedin.com/posts/streamnative_welcome-you-are-invited-to-join-a-webinar[…]84086423552-y8gp/?utm_source=share&amp;utm_medium=member_desktop>

<https://www.academy.streamnative.io/courses/course-v1:streamnative+DEV-210+2024/about>

<https://www.youtube.com/playlist?list=PL7-BmxsE3q4XrdXD9EvdCoX4qYe_GQfYK>