A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hello, I am trying to deploy Datahub on EKS. I was able to properly setup elasticsearch and mysql, and I also have topics created in Kafka. While I deploy `datahub-gms` , I see that it is able to connect to all the endpoints properly but it is *unable to resolve Kafka broker hostnames*. We have our Kafka running on EKS using strimzi operator and I providing the boostrap server URL to datahub-gms.

All other pods in our EKS are able to resolve broker hostnames correctly, seems like the issue is with datahub-gms image. Infact, we use the same endpoint for Pinot tables also. Has anyone faced this issue? Sharing the logs in thread. Please help. Thanks!

```2023-04-26 10:22:35,772 [ThreadPoolTaskExecutor-1] WARN  o.apache.kafka.clients.NetworkClient:969 - [Consumer clientId=consumer-generic-duhe-consumer-job-client-1, groupId=generic-duhe-consumer-job-client] Error connecting to node kafka-kafka-3.kafka-kafka-brokers.kafka.svc:9092 (id: 3 rack: null)
java.net.UnknownHostException: kafka-kafka-3.kafka-kafka-brokers.kafka.svc: Name does not resolve
	at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
	at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:929)
	at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1534)
	at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:848)
	at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1524)
	at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1382)
	at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306)
	at org.apache.kafka.clients.ClientUtils.resolve(ClientUtils.java:110)```


Hey there 👋 I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request.
Let's double check a few things first: ✅ There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? ✅ button ✅ It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? ✅ button Did you find a solution to your issue? ❌ Sorry you weren't able to find a solution. I'm sending you some tips on info you can provide to help the community troubleshoot. Whenever you feel your issue is solved, please react ✅ to your original message to let us know!

I am using the image linkedin/datahub-gms:v0.10.2

The address here looks wrong, you're using the full XXX.svc address. If you're routing into a k8s service it should resolve to DNS. There should probably be a
```selector:
    <http://app.kubernetes.io/name|app.kubernetes.io/name>: XXX```
in your strimzi service that should be utilized.

Got it working without any change in bootstrap server URL. I changed the ndots config to 5 in deployment.yaml and it worked. Previously it was 1.