https://datahubproject.io logo
Join Slack
Powered by
it's `CrashLoopBackOff` ```NAME ...
# troubleshoot
a
it's 
CrashLoopBackOff
Copy code
NAME                                                        READY   STATUS             RESTARTS   AGE
datahub-elasticsearch-master-0                              1/1     Running            0          42m
datahub-elasticsearch-master-1                              1/1     Running            0          42m
datahub-elasticsearch-master-2                              0/1     Running            0          20m
datahub-prerequisites-cp-schema-registry-65d8777cc8-m88mn   1/2     CrashLoopBackOff   10         38m
datahub-prerequisites-kafka-0                               1/1     Running            0          48m
datahub-prerequisites-mysql-0                               1/1     Running            0          66m
datahub-prerequisites-neo4j-community-0                     1/1     Running            0          70m
datahub-prerequisites-zookeeper-0                           1/1     Running            0          45m
b
Hi - please try to keep large blocks of code or debug logs to threads
Can you confirm that the brokers in your bootstrap are avaiable on the network where you are running?
It seems the issue is that the connection from schema registry to the kafka brokers is not successful
a
Hi @big-carpet-38439 thanks for the help. It seems pre-req-kafka running ok see logs below
Copy code
āžœ  datahub-prerequisites kubectl get pods                     
NAME                                                READY   STATUS    RESTARTS   AGE
elasticsearch-master-0                              1/1     Running   0          16h
elasticsearch-master-1                              1/1     Running   0          16h
elasticsearch-master-2                              1/1     Running   0          16h
prerequisites-cp-schema-registry-694cd59d84-x5dtk   2/2     Running   4          4m55s
prerequisites-kafka-0                               1/1     Running   0          6m41s
prerequisites-mysql-0                               1/1     Running   0          16h
prerequisites-neo4j-community-0                     1/1     Running   0          16h
prerequisites-zookeeper-0                           1/1     Running   0          7m7s
āžœ  datahub-prerequisites kubectl logs prerequisites-kafka-0
 09:17:40.25 
 09:17:40.25 Welcome to the Bitnami kafka container
 09:17:40.26 Subscribe to project updates by watching <https://github.com/bitnami/bitnami-docker-kafka>
 09:17:40.26 Submit issues and feature requests at <https://github.com/bitnami/bitnami-docker-kafka/issues>
 09:17:40.26 
 09:17:40.26 INFO  ==> ** Starting Kafka setup **
 09:17:40.31 WARN  ==> You set the environment variable ALLOW_PLAINTEXT_LISTENER=yes. For safety reasons, do not use this flag in a production environment.
 09:17:40.32 INFO  ==> Initializing Kafka...
 09:17:40.32 INFO  ==> No injected configuration files found, creating default config files
 09:17:40.51 INFO  ==> Configuring Kafka for inter-broker communications with PLAINTEXT authentication.
 09:17:40.51 WARN  ==> Inter-broker communications are configured as PLAINTEXT. This is not safe for production environments.
 09:17:40.51 INFO  ==> Configuring Kafka for client communications with PLAINTEXT authentication.
 09:17:40.52 WARN  ==> Client communications are configured using PLAINTEXT listeners. For safety reasons, do not use this in a production environment.
 09:17:40.52 INFO  ==> ** Kafka setup finished! **

 09:17:40.54 INFO  ==> ** Starting Kafka **
[2022-03-02 09:17:41,635] INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$)
[2022-03-02 09:17:42,189] INFO Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation (org.apache.zookeeper.common.X509Util)
[2022-03-02 09:17:42,306] INFO Registered signal handlers for TERM, INT, HUP (org.apache.kafka.common.utils.LoggingSignalHandler)
[2022-03-02 09:17:42,310] INFO starting (kafka.server.KafkaServer)
[2022-03-02 09:17:42,311] INFO Connecting to zookeeper on prerequisites-zookeeper (kafka.server.KafkaServer)
[2022-03-02 09:17:42,329] INFO [ZooKeeperClient Kafka server] Initializing a new session to prerequisites-zookeeper. (kafka.zookeeper.ZooKeeperClient)
[2022-03-02 09:17:42,334] INFO Client environment:zookeeper.version=3.5.9-83df9301aa5c2a5d284a9940177808c01bc35cef, built on 01/06/2021 20:03 GMT (org.apache.zookeeper.ZooKeeper)
[2022-03-02 09:17:42,334] INFO Client environment:host.name=prerequisites-kafka-0.prerequisites-kafka-headless.datahub.svc.cluster.local (org.apache.zookeeper.ZooKeeper)
[2022-03-02 09:17:42,334] INFO Client environment:java.version=11.0.10 (org.apache.zookeeper.ZooKeeper)
[2022-03-02 09:17:42,335] INFO Client environment:java.vendor=BellSoft (org.apache.zookeeper.ZooKeeper)
[2022-03-02 09:17:42,335] INFO Client environment:java.home=/opt/bitnami/java (org.apache.zookeeper.ZooKeeper)
[2022-03-02 09:17:42,335] INFO Client environment:java.class.path=/opt/bitnami/kafka/bin/../libs/activation-1.1.1.jar:/opt/bitnami/kafka/bin/../libs/aopalliance-repackaged-2.6.1.jar:/opt/bitnami/kafka/bin/../libs/argparse4j-0.7.0.jar:/opt/bitnami/kafka/bin/../libs/audience-annotations-0.5.0.jar:/opt/bitnami/kafka/bin/../libs/commons-cli-1.4.jar:/opt/bitnami/kafka/bin/../libs/commons-lang3-3.8.1.jar:/opt/bitnami/kafka/bin/../libs/connect-api-2.8.0.jar:/opt/bitnami/kafka/bin/../libs/connect-basic-auth-extension-2.8.0.jar:/opt/bitnami/kafka/bin/../libs/connect-file-2.8.0.jar:/opt/bitnami/kafka/bin/../libs/connect-json-2.8.0.jar:/opt/bitnami/kafka/bin/../libs/connect-mirror-2.8.0.jar:/opt/bitnami/kafka/bin/../libs/connect-mirror-client-2.8.0.jar:/opt/bitnami/kafka/bin/../libs/connect-runtime-2.8.0.jar:/opt/bitnami/kafka/bin/../libs/connect-transforms-2.8.0.jar:/opt/bitnami/kafka/bin/../libs/hk2-api-2.6.1.jar:/opt/bitnami/kafka/bin/../libs/hk2-locator-2.6.1.jar:/opt/bitnami/kafka/bin/../libs/hk2-utils-2.6.1.jar:/opt/bitnami/kafka/bin/../libs/jackson-annotations-2.10.5.jar:/opt/bitnami/kafka/bin/../libs/jackson-core-2.10.5.jar:/opt/bitnami/kafka/bin/../libs/jackson-databind-2.10.5.1.jar:/opt/bitnami/kafka/bin/../libs/jackson-dataformat-csv-2.10.5.jar:/opt/bitnami/kafka/bin/../libs/jackson-datatype-jdk8-2.10.5.jar:/opt/bitnami/kafka/bin/../libs/jackson-jaxrs-base-2.10.5.jar:/opt/bitnami/kafka/bin/../libs/jackson-jaxrs-json-provider-2.10.5.jar:/opt/bitnami/kafka/bin/../libs/jackson-module-jaxb-annotations-2.10.5.jar:/opt/bitnami/kafka/bin/../libs/jackson-module-paranamer-2.10.5.jar:/opt/bitnami/kafka/bin/../libs/jackson-module-scala_2.12-2.10.5.jar:/opt/bitnami/kafka/bin/../libs/jakarta.activation-api-1.2.1.jar:/opt/bitnami/kafka/bin/../libs/jakarta.annotation-api-1.3.5.jar:/opt/bitnami/kafka/bin/../libs/jakarta.inject-2.6.1.jar:/opt/bitnami/kafka/bin/../libs/jakarta.validation-api-2.0.2.jar:/opt/bitnami/kafka/bin/../libs/jakarta.ws.rs-api-2.1.6.jar:/opt/bitnami/kafka/bin/../libs/jakarta.xml.bind-api-2.3.2.jar:/opt/bitnami/kafka/bin/../libs/javassist-3.27.0-GA.jar:/opt/bitnami/kafka/bin/.
[2022-03-02 09:17:43,987] INFO Feature ZK node created at path: /feature (kafka.server.FinalizedFeatureChangeListener)
[2022-03-02 09:17:44,012] INFO [GroupCoordinator 0]: Starting up. (kafka.coordinator.group.GroupCoordinator)
[2022-03-02 09:17:44,030] INFO [GroupCoordinator 0]: Startup complete. (kafka.coordinator.group.GroupCoordinator)
[2022-03-02 09:17:44,056] INFO Updated cache from existing <empty> to latest FinalizedFeaturesAndEpoch(features=Features{}, epoch=0). (kafka.server.FinalizedFeatureCache)
[2022-03-02 09:17:44,096] INFO [ProducerId Manager 0]: Acquired new producerId block (brokerId:0,blockStartProducerId:0,blockEndProducerId:999) by writing to Zk with path version 1 (kafka.coordinator.transaction.ProducerIdManager)
[2022-03-02 09:17:44,107] INFO [TransactionCoordinator id=0] Starting up. (kafka.coordinator.transaction.TransactionCoordinator)
[2022-03-02 09:17:44,122] INFO [TransactionCoordinator id=0] Startup complete. (kafka.coordinator.transaction.TransactionCoordinator)
[2022-03-02 09:17:44,142] INFO [Transaction Marker Channel Manager 0]: Starting (kafka.coordinator.transaction.TransactionMarkerChannelManager)
[2022-03-02 09:17:44,220] INFO [ExpirationReaper-0-AlterAcls]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2022-03-02 09:17:44,309] INFO [/config/changes-event-process-thread]: Starting (kafka.common.ZkNodeChangeNotificationListener$ChangeEventProcessThread)
[2022-03-02 09:17:44,326] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Starting socket server acceptors and processors (kafka.network.SocketServer)
[2022-03-02 09:17:44,331] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Started data-plane acceptor and processor(s) for endpoint : ListenerName(INTERNAL) (kafka.network.SocketServer)
[2022-03-02 09:17:44,341] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Started data-plane acceptor and processor(s) for endpoint : ListenerName(CLIENT) (kafka.network.SocketServer)
[2022-03-02 09:17:44,342] INFO [SocketServer listenerType=ZK_BROKER, nodeId=0] Started socket server acceptors and processors (kafka.network.SocketServer)
[2022-03-02 09:17:44,356] INFO Kafka version: 2.8.0 (org.apache.kafka.common.utils.AppInfoParser)
[2022-03-02 09:17:44,356] INFO Kafka commitId: ebb1d6e21cc92130 (org.apache.kafka.common.utils.AppInfoParser)
[2022-03-02 09:17:44,356] INFO Kafka startTimeMs: 1646212664342 (org.apache.kafka.common.utils.AppInfoParser)
[2022-03-02 09:17:44,357] INFO [KafkaServer id=0] started (kafka.server.KafkaServer)
[2022-03-02 09:17:44,454] INFO [broker-0-to-controller-send-thread]: Recorded new controller, from now on will use broker prerequisites-kafka-0.prerequisites-kafka-headless.datahub.svc.cluster.local:9093 (id: 0 rack: null) (kafka.server.BrokerToControllerRequestThread)
teamwork 1
3 Views
Open in Slack
PreviousNext
Powered by