https://datahubproject.io logo
Join Slack
Powered by
Hello. I failed to set up cp-schema-registry corre...
# all-things-deployment
m
Hello. I failed to set up cp-schema-registry correctly. What I was doing was run confluentinc/cp-schema-registry:5.4.0 with zookeeper setting. Then I tailed the docker logs
Copy code
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.5.6-c11b7e26bc554b8523dc929761dd28808913f091, built on 10/08/2019 20:18 GMT
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=<http://schema-registry-test-0a02a454.ec2.pin220.com|schema-registry-test-0a02a454.ec2.pin220.com>
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_212
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Azul Systems, Inc.
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/lib/jvm/zulu-8-amd64/jre
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/etc/confluent/docker/docker-utils.jar
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/tmp
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=5.4.0-1041-aws
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=root
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=/root
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.free=230MB
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.max=3456MB
[main] INFO org.apache.zookeeper.ZooKeeper - Client environment:os.memory.total=234MB
[main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=zookeeper-dynamic-schema-registry-dev-0a0c00b7:2181 sessionTimeout=40000 watcher=io.confluent.admin.utils.ZookeeperConnectionWatcher@6f539caf
[main] INFO org.apache.zookeeper.common.X509Util - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
[main] INFO org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 4194304 Bytes
[main] INFO org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=
[main-SendThread(zookeeper-dynamic-schema-registry-dev-0a0c00b7:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server zookeeper-dynamic-schema-registry-dev-0a0c00b7/10.12.0.183:2181. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(zookeeper-dynamic-schema-registry-dev-0a0c00b7:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /10.2.164.84:33680, server: zookeeper-dynamic-schema-registry-dev-0a0c00b7/10.12.0.183:2181
[main-SendThread(zookeeper-dynamic-schema-registry-dev-0a0c00b7:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server zookeeper-dynamic-schema-registry-dev-0a0c00b7/10.12.0.183:2181, sessionid = 0x500acfbbd7b5afa, negotiated timeout = 40000
[main] INFO org.apache.zookeeper.ZooKeeper - Session: 0x500acfbbd7b5afa closed
[main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x500acfbbd7b5afa
[main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=zookeeper-dynamic-schema-registry-dev-0a0c00b7:2181 sessionTimeout=40000 watcher=io.confluent.admin.utils.ZookeeperConnectionWatcher@799f7e29
[main] INFO org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 4194304 Bytes
[main] INFO org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=
[main-SendThread(zookeeper-dynamic-schema-registry-dev-0a0c00b7:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server zookeeper-dynamic-schema-registry-dev-0a0c00b7/10.12.0.183:2181. Will not attempt to authenticate using SASL (unknown error)
[main-SendThread(zookeeper-dynamic-schema-registry-dev-0a0c00b7:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /10.2.164.84:33682, server: zookeeper-dynamic-schema-registry-dev-0a0c00b7/10.12.0.183:2181
[main-SendThread(zookeeper-dynamic-schema-registry-dev-0a0c00b7:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server zookeeper-dynamic-schema-registry-dev-0a0c00b7/10.12.0.183:2181, sessionid = 0x500acfbbd7b5afb, negotiated timeout = 40000
[main] INFO org.apache.zookeeper.ZooKeeper - Session: 0x500acfbbd7b5afb closed
[main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x500acfbbd7b5afb
[main] ERROR io.confluent.admin.utils.cli.KafkaReadyCommand - Error while running kafka-ready.
org.apache.kafka.common.errors.TimeoutException: Timed out waiting for Kafka to register brokers in Zookeeper. timeout (ms) = 40000
Do you know what is the problem? Thanks
l
@early-lamp-41924 ^
e
we never tried it with the zookeeper setting. Any reason why you are not using bootstrap server address instead?
m
What is the bootstrap server address? I was saying I put my zookeeper host name here https://github.com/linkedin/datahub/blob/master/docker/schema-registry/env/docker.env#L2
e
ah yeah
so you need to put the bootstrap server url
oh wait nvm sry
I did not know we do this on our quickstart. could you post the result of running
Copy code
docker container ls
m
Hi @early-lamp-41924 Can I schedule a meeting with you? I am available today, and most time tomorrow.
I will show you docker container ls, but it is better with some explanation. Pinterest infra is different.
e
Yes!
I am free now if you are
otherwise let’s set sth up for tmr morning
m
Ah. I am off now. Shall we meet tomorrow morning? Thanks!
e
Sounds good. Should be free starting 10AM PST! DM me when you are free
m
Yes. 10am works for me . See you tomorrow
h
I would be interested in the outcome of this. I had the same problem.
m
To join the video meeting, click this link: https://meet.google.com/ifw-ahwq-taa Otherwise, to join by phone, dial +1 510-560-5749 and enter this PIN: 610 449 269# To view more phone numbers, click this link: https://tel.meet/ifw-ahwq-taa?hs=5
e
SCHEMA_REGISTRY_KAFKASTORE_BOOTSTRAP_SERVERS
h
How did you resolve it?
m
Hi @high-family-71209 It is not solved yet. But I found the schema-regstry's zookeeper (
SCHEMA_REGISTRY_KAFKASTORE_BOOTSTRAP_SERVERS
or 
SCHEMA_REGISTRY_KAFKASTORE_CONNECTION_URL
) is different from the one in broker. Since we are using internal broker and zookeeper, I am contacting our internal team to give me a consistent zookeeper of broker, then I set the zookeeper at schema-registry. Then it should work.
h
Thanks @mysterious-lamp-91034 - but is that a local issue or something within datahub?
m
No. It is my bad. A bad configuration
h
Too bad, I was hoping this would solve the quickstart problems I was having 🙂 Fingers crossed for you!
Open in Slack
PreviousNext
Powered by