Hi Team, I am trying to ingest the kafka data into datahub Can someone please help me with the cluster_id? How should I find my cluster_id and what should I put in the platform_instance? Below is the config that I have source: type: kafka config: # Replace with your cluster ID platform_instance: connection: bootstrap: "http://prerequisites-kafka.telco-dataprocessing-mvp.svc.cluster.local:9092" # Uncomment and add secrets in Secrets Tab # consumer_config: # security.protocol: "SASL_SSL" # sasl.mechanism: "PLAIN" # sasl.username: "${CLUSTER_API_KEY_ID}" # sasl.password: "${CLUSTER_API_KEY_SECRET}" schema_registry_url: "http://prerequisites-kafka.telco-dataprocessing-mvp.svc.cluster.local:9092" # Uncomment and add secrets in Secrets Tab # schema_registry_config: # basic.auth.user.info: "${REGISTRY_API_KEY_ID}:${REGISTRY_API_KEY_SECRET}" sink: type: datahub-rest config: server: 'http://datahub-mvp-datahub-gms.telco-dataprocessing-mvp.svc.cluster.local:8080' # Add a secret in secrets Tab token: null

As described in the kafka source doc , you can use

platform_instance

config to specify a string value that uniquely identifies the kafka cluster being ingested . e.g. cluster id. It can also be something other than cluster id, for example, logical name for cluster. You'll be able to find cluster id by following the docs for your kafka cluster. For example - here are the docs on how to find cluster id for confluence kafka cluster - https://docs.confluent.io/5.3.4/security/rbac/rbac-get-cluster-ids.html#get-kafka-cluster-id

I already referred the confluent page but not able to get the cluster id in zookeeper