```2021/06/29 08:13:35 Waiting for: <tcp://prerequ...
# all-things-deployment
c
Copy code
2021/06/29 08:13:35 Waiting for: <tcp://prerequisites-mysql:3306>
2021/06/29 08:13:35 Waiting for: <tcp://prerequisites-kafka:9092>
2021/06/29 08:13:35 Waiting for: <http://elasticsearch-master:9200>
2021/06/29 08:13:35 Waiting for: http:
2021/06/29 08:13:35 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/06/29 08:13:35 Connected to <tcp://prerequisites-mysql:3306>
2021/06/29 08:13:35 Connected to <tcp://prerequisites-kafka:9092>
2021/06/29 08:13:35 Received 200 from <http://elasticsearch-master:9200>
2021/06/29 08:13:36 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/06/29 08:13:37 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/06/29 08:13:38 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/06/29 08:13:39 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/06/29 08:13:40 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/06/29 08:13:41 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/06/29 08:13:42 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/06/29 08:13:43 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/06/29 08:13:44 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/06/29 08:13:45 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
l
@early-lamp-41924 ^
e
@cool-iron-6335 which image version are you using?
c
I clone the repository from master in github and use the default config
e
Sent out a PR to move helm to v0.8.4
in the meantime can you string replace v0.8.3 to v0.8.4 in the helm charts?
PR has been merged. Can you retry after pulling latest?
c
@early-lamp-41924 I had pulled out the latest version with image version is v0.8.4 but it seems not to work right now. There is some thing wrong with mysql setup job
Normal   Scheduled  9m53s                   default-scheduler  Successfully assigned default/datahub-mysql-setup-job-xtq7r to minikube
Normal   Pulling    8m7s (x4 over 9m52s)    kubelet            Pulling image "acryldata/datahub-mysql-setup:v0.8.4"
Warning  Failed     8m3s (x4 over 9m48s)    kubelet            Failed to pull image "acryldata/datahub-mysql-setup:v0.8.4": rpc error: code = Unknown desc = Error response from daemon: manifest for acryldata/datahub-mysql-setup:v0.8.4 not found: manifest unknown: manifest unknown
Warning  Failed     8m3s (x4 over 9m48s)    kubelet            Error: ErrImagePull
Normal   BackOff    7m49s (x6 over 9m48s)   kubelet            Back-off pulling image "acryldata/datahub-mysql-setup:v0.8.4"
Warning  Failed     4m42s (x19 over 9m48s)  kubelet            Error: ImagePullBackOff
e
Hey! Can you try again? Should be fixed now. Thanks for the Patience
🙌 1
c
@early-lamp-41924 Can you check mae consumer component, please ? It can't be ready with exit code is 1. I got this error when i tried to enable mae and mce components
datahub-datahub-frontend-86944c46d7-7llxq          1/1     Running     0          3m5s
datahub-datahub-gms-5bbc4f8c99-sdbjj               1/1     Running     0          3m5s
datahub-datahub-mae-consumer-7bf8bf4dbf-25fkm      0/1     Running     0          3m5s
datahub-datahub-mce-consumer-576f8947fc-zkmwx      1/1     Running     0          3m5s
datahub-datahub-upgrade-job-497hw                  0/1     Error       0          2m32s
datahub-datahub-upgrade-job-c6rsm                  0/1     Error       0          3m5s
datahub-datahub-upgrade-job-x4n8h                  0/1     Completed   0          98s
datahub-elasticsearch-setup-job-g9ggr              0/1     Completed   0          3m32s
datahub-kafka-setup-job-vxqjs                      0/1     Completed   0          3m29s
datahub-mysql-setup-job-jgztk                      0/1     Completed   0          3m6s
elasticsearch-master-0                             1/1     Running     0          5m36s
elasticsearch-master-1                             1/1     Running     0          5m36s
elasticsearch-master-2                             1/1     Running     0          5m36s
prerequisites-cp-schema-registry-cf79bfccf-rr2zg   2/2     Running     1          5m36s
prerequisites-kafka-0                              1/1     Running     1          5m36s
prerequisites-mysql-0                              1/1     Running     0          5m36s
prerequisites-zookeeper-0                          1/1     Running     0          5m36s
e
Hey. We got reports of this yesterday and put out a fix. We just released v0.8.5 with the fix. Can you try pulling latest master and redeploying? Sorry about that
c
I really appreciate that. But it seems you not to release new version of mysql job yet. Hopefully you can check all components of DataHub when using elasticsearch as graphic service
Normal   Scheduled  9m20s                  default-scheduler  Successfully assigned default/datahub-mysql-setup-job-zkkpc to minikube
Normal   Pulling    7m47s (x4 over 9m19s)  kubelet            Pulling image "acryldata/datahub-mysql-setup:v0.8.5"
Warning  Failed     7m43s (x4 over 9m15s)  kubelet            Failed to pull image "acryldata/datahub-mysql-setup:v0.8.5": rpc error: code = Unknown desc = Error response from daemon: manifest for acryldata/datahub-mysql-setup:v0.8.5 not found: manifest unknown: manifest unknown
Warning  Failed     7m43s (x4 over 9m15s)  kubelet            Error: ErrImagePull
Normal   BackOff    7m5s (x7 over 9m14s)   kubelet            Back-off pulling image "acryldata/datahub-mysql-setup:v0.8.5"
Warning  Failed     4m7s (x19 over 9m14s)  kubelet            Error: ImagePullBackOff
e
My bad. Pushed!
c
@early-lamp-41924 I don't know why it doesn't work for me. I still get error when using elasticsearch as graphic service but not with neo4j. There is always something wrong with mae consumer component even with the latest version of v8.0.5
datahub-datahub-frontend-76866f8676-zsqnz 1/1 Running 0 4m27s
datahub-datahub-gms-778857c8cb-tqpxh 1/1 Running 0 4m27s
datahub-datahub-mae-consumer-69675584c6-6fpl8 0/1 Running 0 4m27s
datahub-datahub-mce-consumer-568749b6b4-9tknj 1/1 Running 0 4m27s
datahub-datahub-upgrade-job-9lt9s 0/1 Completed 0 68s
datahub-datahub-upgrade-job-h8lwz 0/1 Error 0 3m25s
datahub-datahub-upgrade-job-ph5t4 0/1 Error 0 4m27s
datahub-datahub-upgrade-job-t7qsb 0/1 Error 0 2m29s
datahub-elasticsearch-setup-job-w64pb 0/1 Completed 0 4m55s
datahub-kafka-setup-job-xclrz 0/1 Completed 0 4m52s
datahub-mysql-setup-job-pgxms 0/1 Completed 0 4m29s
e
That is not an error! It is worning fine
Update job tries running until all baclend pods are up
then completes. While doing so it fails
Aslong as the most recent one completed we are good!
My bad. Hmn mae consumer is not ready. Can you post the logs before crashing?
c
Copy code
2021/07/02 06:43:40 Waiting for: <tcp://prerequisites-kafka:9092>
2021/07/02 06:43:40 Waiting for: <http://elasticsearch-master:9200>
2021/07/02 06:43:40 Waiting for: http:
2021/07/02 06:43:40 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/07/02 06:43:40 Received 200 from <http://elasticsearch-master:9200>
2021/07/02 06:43:40 Connected to <tcp://prerequisites-kafka:9092>
2021/07/02 06:43:41 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/07/02 06:43:42 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/07/02 06:43:43 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/07/02 06:43:44 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
2021/07/02 06:43:45 Problem with request: Get http:: http: no Host in request URL. Sleeping 1s
It constantly get problem with request
e
@green-football-43791 We didn’t remove neo4j checks for mae consumer job 😞
g
sorry about that @cool-iron-6335 - I have PR up here to fix that: https://github.com/linkedin/datahub/pull/2824
if once that gets merged we can cut another release
👍 1
c
@green-football-43791 I can see that you'd pushed a version of supporting mae without neo4j and I'd tried thing out installing DataHub on Kubernetes but it seems not to work. Can I install DataHub on Kubernetes without neo4j right now ?
g
Hey @cool-iron-6335 - we will cut a release Tuesday that includes this fix. I will let you know when it is out!
r
@cool-iron-6335 I am facing this same error, were you able to find a fix?