https://datahubproject.io logo
Join Slack
Powered by
Hi getting this error in datahub-elasticsearch-set...
# all-things-deployment
b
Hi getting this error in datahub-elasticsearch-setup-job
Copy code
Timeout after 2m0s waiting on dependencies to become available: [<http://elasticsearch-master:9200>]
i'm able to curl elastic search on port forward
Copy code
->curl localhost:9200

{
  "name" : "elasticsearch-master-0",
  "cluster_name" : "elasticsearch",
  "cluster_uuid" : "s-2yYjHTTgy4c9p2I6w0Ug",
  "version" : {
    "number" : "7.9.3",
    "build_flavor" : "default",
    "build_type" : "docker",
    "build_hash" : "c4138e51121ef06a6404866cddc601906fe5c868",
    "build_date" : "2020-10-16T13:34:25.304557Z",
    "build_snapshot" : false,
    "lucene_version" : "8.6.2",
    "minimum_wire_compatibility_version" : "6.8.0",
    "minimum_index_compatibility_version" : "6.0.0-beta1"
  },
  "tagline" : "You Know, for Search"
}
s
this is docker or K8s? If docker please share the status
Copy code
docker ps -a
b
k8s
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2e3f2c154d2d d96dacce178f "/etc/confluent/dock…" 23 minutes ago Up 23 minutes k8s_cp-schema-registry-server_prerequisites-cp-schema-registry-cf79bfccf-98cns_default_d45dd815-bf6d-4b6e-8d88-8a08d09e357b_5 01b10c57f754 1ab635cd4cb0 "/scripts/setup.sh" 24 minutes ago Up 24 minutes k8s_kafka_prerequisites-kafka-0_default_1c37ae41-e340-4b29-a7ec-c501ea4e6260_2 8d9e741e90ca 32bb4bf1ee42 "/tini -- /usr/local…" 31 minutes ago Up 31 minutes k8s_elasticsearch_elasticsearch-master-0_default_f1cc42c4-0e37-4074-a99d-5d55e49cf44e_0 0d5cf3213ed5 e2ff4fd9a828 "bash -ec '# Execute…" 31 minutes ago Up 31 minutes k8s_zookeeper_prerequisites-zookeeper-0_default_29c9a18c-645d-465b-9fb2-3ec94b1176fc_0 a1340dabcbbb 36f9e9d8127b "java -XX:+UnlockExp…" 31 minutes ago Up 31 minutes k8s_prometheus-jmx-exporter_prerequisites-cp-schema-registry-cf79bfccf-98cns_default_d45dd815-bf6d-4b6e-8d88-8a08d09e357b_0 a89930e76915 746f84535e08 "/opt/bitnami/script…" 31 minutes ago Up 31 minutes k8s_mysql_prerequisites-mysql-0_default_3c5a45d7-5176-48cf-942b-0f8ccf464b58_0
s
Are you doing this deployment for the first time? What version of datahub and helm charts?
b
previously i deployed 0.8.17 version. Now i'm installing 0.8.18
i
Hello Mani, Could you post the output of 
kubectl get all
in the k8s namespace where you are deploying datahub?
Is this a clean install or an upgrade of an existing datahub deployment?
b
Yeah can we try on 0.8.19.. 🙂 we have not seen this one before
b
@big-carpet-38439 i tried with latest version still getting same error
@incalculable-ocean-74010 i'm doing a clean install
output of kubectl get all
values i'm using for deployment
datahub_values_2.yamlvalues_2.yaml
i
It looks like the elasticsearch setup job failed, can you share the logs?
Copy code
kubectl get logs pod/datahub-elasticsearch-setup-job-kqw99
b
Also - are you able to navigate to UI and ingest some data? i'm trying to understand how this is functionally affecting thing
b
logs
Copy code
2021/12/22 10:54:11 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:12 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:13 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:14 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:15 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:16 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:17 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:18 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:19 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:20 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:21 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:22 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:23 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:24 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:25 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:26 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:27 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:28 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:29 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:30 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:31 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:32 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:33 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:34 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:35 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
2021/12/22 10:54:36 Problem with request: Get <http://elasticsearch-master:9200>: dial tcp 10.101.149.110:9200: connect: connection refused. Sleeping 1s
i
Is that the entirety of the file? Can you search show the lines before you kept getting repeated logs?
b
Hi the issue is with elastic search pod . Readiness probe failed: Waiting for elasticsearch cluster to become ready
i
Could you share the logs of the elastic search pod? I failed notice that it was running with 0/1 status.
Open in Slack
PreviousNext
Powered by