Hi, everyone, I am trying to install datahub in th...
# all-things-deploymentf
fast-ice-59096
10/13/2022, 1:08 PMHi, everyone, I am trying to install datahub in the azure kubernetes service. When I use the instruction helm install datahub datahub/datahub, I get the error Error: INSTALLATION FAILED: failed pre-install: timed out waiting for the condition. All the prerequises are running. Does anyone Know what I can do?
b
better-orange-49102
10/13/2022, 1:14 PMSee what datahub pods are running and look at the logs.
f
fast-ice-59096
10/13/2022, 2:20 PMI checked and although the error the pods are running. Now I am trying to access the frontend and it doen't work. I tried to use ingress-nginx-controller and nothing appears when I browse to the external IP.
b
better-orange-49102
10/13/2022, 2:22 PMI would look at the gms and frontend logs and make sure they're running ok. Or port forward to port 9002 to eliminate the ingress as the source of the problem
f
fast-ice-59096
10/13/2022, 2:24 PMI did port forward to port 9002. And localhost:9002 has nothing
b
bulky-electrician-72362
10/13/2022, 3:16 PM@fast-ice-59096 can you check the logs on the frontend pod?
what do you experence when you try access the porforwarded localhost:9002?
f
fast-ice-59096
10/13/2022, 3:19 PMHi, Peter, It doesn't load.
b
better-orange-49102
10/13/2022, 3:42 PMPlease examine the output from 'kubectl logs <pod>' where <pod> is the id from 'kubectl get pods'
f
fast-ice-59096
10/14/2022, 8:46 AMHi, xL, I checked the logs: only warn messages like that: 083547 [kafka-producer-network-thread | datahub-frontend] WARN o.apache.kafka.clients.NetworkClient - [Producer clientId=datahub-frontend] Connection to node -1 (prerequisites-kafka/10.0.85.117:9092) could not be established. Broker may not be available.
083550 [kafka-producer-network-thread | datahub-frontend] WARN o.apache.kafka.clients.NetworkClient - [Producer clientId=datahub-frontend] Connection to node -1 (prerequisites-kafka/10.0.85.117:9092) could not be established. Broker may not be available.
083552 [kafka-producer-network-thread | datahub-frontend] INFO org.apache.kafka.clients.Metadata - [Producer clientId=datahub-frontend] Cluster ID: XJjJDQkBTd-NGSzddrvyOQ
b
better-orange-49102
10/14/2022, 8:59 AMGMS cannot access kafka. Did you follow all the steps for the helm tutorial? Or you used some kind of managed kafka?
f
fast-ice-59096
10/14/2022, 9:01 AMI used helm install prerequisites datahub/datahub-prerequisites from datahub project. I didn't change any file. I used the ones from the repository
fast-ice-59096
10/14/2022, 9:07 AMEvery time I try helm install datahub datahub/datahub I get Error: INSTALLATION FAILED: failed pre-install: timed out waiting for the condition. In order to install I need to use helm install datahub datahub/datahub --no-hooks. I really need help
b
better-orange-49102
10/14/2022, 9:08 AMI don't have an issue with the instructions. Maybe @microscopic-australia-66302 might be better positioned to advise on helm, cos I'm quite beginner with helm
f
fast-ice-59096
10/14/2022, 10:17 AMChecking the pods after running helm install datahub datahub/datahub and getting Error: INSTALLATION FAILED: failed pre-install: timed out waiting for the condition, I check the pods and this appeared: NAME READY STATUS RESTARTS AGE
datahub-elasticsearch-setup-job-2kt6k 0/1 Error 0 13m
datahub-elasticsearch-setup-job-4dt47 0/1 Error 0 12m
datahub-elasticsearch-setup-job-58zrc 0/1 Error 0 11m
datahub-elasticsearch-setup-job-gd7fd 0/1 Error 0 10m
datahub-elasticsearch-setup-job-mh7hv 0/1 Error 0 7m44s
datahub-elasticsearch-setup-job-ndhn6 0/1 Error 0 12m
datahub-elasticsearch-setup-job-q87l2 0/1 Error 0 12m
elasticsearch-master-0 1/1 Running 0 16m
elasticsearch-master-1 1/1 Running 0 16m
elasticsearch-master-2 1/1 Running 0 16m
prerequisites-cp-schema-registry-6f4b5b894f-4kz4z 2/2 Running 0 16m
prerequisites-kafka-0 1/1 Running 0 16m
prerequisites-mysql-0 1/1 Running 0 16m
prerequisites-neo4j-community-0 1/1 Running 0 16m
prerequisites-zookeeper-0 1/1 Running 0 16m
fast-ice-59096
10/14/2022, 10:20 AMChecking the logs from the error pods, I get: 2022/10/14 100152 Waiting for: http://elasticsearch-master:9200
Going to use protocol: http
Going to use default elastic headers
Create datahub_usage_event if needed against Elasticsearch at elasticsearch-master:9200
Going to use index prefix::
2022/10/14 100152 Received 200 from http://elasticsearch-master:9200
curl: option -k http://elasticsearch-master:9200/_ilm/policy/datahub_usage_event_policy: is unknown
curl: try 'curl --help' or 'curl --manual' for more information
Policy GET response code is
/create-indices.sh: line 41: [: -eq: unary operator expected
/create-indices.sh: line 45: [: -eq: unary operator expected
/create-indices.sh: line 47: [: -eq: unary operator expected
Got response code while creating policy so exiting.
2022/10/14 100152 Command exited with error: exit status 1
PS /home/jose_oliveira/clouddrive> kubectl logs datahub-elasticsearch-setup-job-4dt47
2022/10/14 100205 Waiting for: http://elasticsearch-master:9200
2022/10/14 100205 Received 200 from http://elasticsearch-master:9200
Going to use protocol: http
Going to use default elastic headers
Create datahub_usage_event if needed against Elasticsearch at elasticsearch-master:9200
Going to use index prefix::
curl: option -k http://elasticsearch-master:9200/_ilm/policy/datahub_usage_event_policy: is unknown
curl: try 'curl --help' or 'curl --manual' for more information
Policy GET response code is
/create-indices.sh: line 41: [: -eq: unary operator expected
/create-indices.sh: line 45: [: -eq: unary operator expected
/create-indices.sh: line 47: [: -eq: unary operator expected
2022/10/14 100205 Command exited with error: exit status 1
Got response code while creating policy so exiting.
fast-ice-59096
10/14/2022, 10:23 AMPlease, does anyone have any idea of what it is happening? Isaw ina forum that it would be a problem of VM configuration and I have 4 CPU and 16GB RAM running, and the problem persists
b
bulky-electrician-72362
10/14/2022, 12:50 PMES setupjob has a bug in 0.8.45. Could you change the es setupjob version to 0.8.44 in you values.yaml?
f
fast-ice-59096
10/14/2022, 12:51 PMDo you know how I can do this?
fast-ice-59096
10/14/2022, 12:53 PMI searched in the web, and I didn't find any tutorial
b
bulky-electrician-72362
10/14/2022, 1:03 PMDid you follow the instruction here? https://github.com/acryldata/datahub-helm
f
fast-ice-59096
10/14/2022, 1:05 PMYes, I followed exactly this instruction
b
bulky-electrician-72362
10/14/2022, 1:25 PMtry running
Copy code
helm upgrade datahub datahub/datahub --version 0.2.109f
fast-ice-59096
10/14/2022, 1:29 PMI got the error: Error: failed to download "datahub/datahub" at version "0.2.109"
b
better-orange-49102
10/17/2022, 10:45 AMhelm repo updatef
fast-ice-59096
10/17/2022, 10:46 AMHi, I will try to update the repo
fast-ice-59096
10/17/2022, 11:19 AMThank you very much, @better-orange-49102 and @bulky-electrician-72362. I could deploy DataHub with your help
b
bulky-electrician-72362
10/17/2022, 12:56 PMGood stuff, thanks @better-orange-49102 🙌