I tried to run DataHub using CLI command ‘datahu...
# troubleshoot
s
I tried to run DataHub using CLI command ‘datahub docker quickstart’, but I got the error like bellow: elasticsearch is up-to-date mysql is up-to-date zookeeper is up-to-date neo4j is up-to-date Starting elasticsearch-setup ... Starting mysql-setup ... datahub-gms is up-to-date Starting elasticsearch-setup ... done Starting mysql-setup ... done Starting broker ... done Starting schema-registry ... done kafka-setup is up-to-date ............. Unable to run quickstart - the following issues were detected: • kafka-setup is still running • datahub-gms is still starting • broker is not running If you think something went wrong, please file an issue at https://github.com/datahub-project/datahub/issues or send a message in our Slack https://slack.datahubproject.io/ Be sure to attach the logs from /tmp/tmppcedmu0q.log How do I figure it out? Please, help me….
d
If you have nothin importan in your local datahub then can you try to nuke your data with
datahub docker nuke
and rerun the quickstart?
s
Thank you for your reply. I did nuked docker with ‘datahub docker nuke’ then ran ‘datahub docker quickstart’, but I got same error.
i
@sticky-dawn-95000 could you share the logs? The file you shared is a binary?
s
I attach a log file.
Can I upload a log file as text format? When I attach a file, it is automatically uploaded as binary file. But I can open a log file I shared in text editor.
b
i also encountered the following messages as OP whenever i cannot start up datahub lately. trying to figure out how to overcome this line
Copy code
[36mbroker                    |[0m [2022-04-01 07:11:11,234] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
[36mbroker                    |[0m kafka.common.InconsistentClusterIdException: The Cluster ID V9WljOYIR7OA8OF2v41BiA doesn't match stored clusterId Some(FbqCKN4xQLuM-8w7GjM36A) in meta.properties. The broker is trying to join the wrong cluster. Configured zookeeper.connect may be wrong.
[36mbroker                    |[0m 	at kafka.server.KafkaServer.startup(KafkaServer.scala:220)
[36mbroker                    |[0m 	at io.confluent.support.metrics.SupportedServerStartable.startup(SupportedServerStartable.java:114)
[36mbroker                    |[0m 	at io.confluent.support.metrics.SupportedKafka.main(SupportedKafka.java:66)
[36mbroker                    |[0m [2022-04-01 07:11:11,245] INFO shutting down (kafka.server.KafkaServer)
[36mbroker                    |[0m [2022-04-01 07:11:11,250] INFO [ZooKeeperClient Kafka server] Closing. (kafka.zookeeper.ZooKeeperClient)
the error is randomly happening to me, sometimes fresh instance also cannot startup (with no prior docker volumes)
@sticky-dawn-95000 can you type in your terminal
Copy code
docker volume ls
and check if datahub_broker is listed there?
s
@better-orange-49102 Thank you for your reply. Datahub_broker is listed in my docker volumes. Here is my result of ‘docker volume ls’. DRIVER VOLUME NAME local 4b086db83ff3dda2bc63ba8f0d754b571a45315adc8421d52c73a257e2a05aed local 5d8a302df2ff8d384f24a511bcbbbd4169ab9a1b030b8022dc1e5d12eff2e7b0 local 5eac346edccafa3e4c457731098c5bccbf4409c5471962ecb5a401f333cc424e local 7b4c33bb494f03a8e4ef4797be8f1f02c0583242af74b9143795671be9776cc0 local 7bd89f6cbd9515b034b37ab46ef5877542b6dd27fb25fb5fbb24d55e70b89d09 local 9b03249349a2b5111597756b4d30fbc5fd4abc1282452c340a6d5a824df8677d local 50c540dc25eff6fac6678cb3be2530a6239a792db84b024abc8107e28e09fdd0 local 61d6071d828dd88e4f3b5458686564e0477227704a47c4398324388ccd6341c9 local 90bce8e99559c524195d40728e5576fb60a3383f919ac721121aba65412400f1 local 276f192fc49556769bedca26696776cd24f96ba5b35cb8fd680de8358c8bff22 local 407d7496ec8648c37a5c6b15413cedc92a7260d32823c727b17ca0559bd7d25c local 790ec88bc3106e06c3bb27e64a3f6bc4769e4e3b5dcb8ac9a4b4e6032f6c0e91 local 4833d2aba6860d37ee3fc6d2712b705166cd7a6be9abf038361cbef4738efbfa local 7055b4e47432980fb9c7ffaaef942769b602cc205f46633144dd7f3c18fb78c2 local 31735f76b3eb7a1aeab8d9bdfd36e6d7700fc19bdedfd4e304006471d2e755e1 local 77251e0c441018c59686c88dfaa7aa8a396759a4555b769f39d9a1378136ce48 local 291768acb8d23feea70aa787863fb7c87e159ca4b856cb6e5125867fcfb750c5 local 656695ba25fc76cbf177d26934b4625e515f3b1de7cf16cca0fad4eb59514703 local 705698f4c18177ee530262430a390cad1626ff95c5f8614e9a344f3f310580fe local 77495116c5ff7f416749b94d0e61fa6323257bba6e3c8315a431fc46e7d707e0 local c7f623ebf7f29a7784063094bfd97831d2a6984c384130202370b24f4dae80d8 local ca813596c2437806532e2eb6363cc1285baa0da79a95453e3c4bb2ef4ad816da local dac9fccdff046ee46627a05b9b921558a1dcdff06c2dccf081fb071e92d0eebc local datahub_broker local datahub_esdata local datahub_mysqldata local datahub_neo4jdata local datahub_zkdata local e9ae9b184ac06b09c9a555b0f95d7e241ab7c7a0b7a8a1b8f29c2b924ea6da14 local ecb8d4721ed552ff2340f3ce62af9e1f2dc0c97e38b3cc1b34863379febffd3e local ef57776061b507e2bfb5f633909c0dc16f0050db6526a2ab2482c88c823929d1
b
if you're still stuck, may I propose the following, bring down datahub, then
Copy code
docker volume rm datahub_broker
then followed datahub docker quickstart
s
Thank you for your help. :) It works well after remove all local volume ‘docker volume prune’.
b
actually i only meant for you to remove broker volume 🙂 not everything
i don't understand the root cause myself 🤷‍♂️
s
@better-orange-49102 I removed all docker volumes for just test. Don't worry there are no data. You guided right way. 🙂