Hello there! Anyone seen this before? ```$ ./dock...
# getting-started
g
Hello there! Anyone seen this before?
Copy code
$ ./docker/quickstart.sh
Pulling elasticsearch        ... done
Pulling mysql                ... done
Pulling elasticsearch-setup  ... done
Pulling kibana               ... done
Pulling neo4j                ... done
Pulling zookeeper            ... done
Pulling broker               ... done
Pulling schema-registry      ... done
Pulling schema-registry-ui   ... done
Pulling kafka-setup          ... done
Pulling datahub-mae-consumer ... done
Pulling kafka-rest-proxy     ... done
Pulling kafka-topics-ui      ... done
Pulling datahub-gms          ... done
Pulling datahub-mce-consumer ... done
Pulling datahub-frontend     ... done
Building elasticsearch-setup
Sending build context to Docker daemon  27.78MB

Step 1/10 : ARG APP_ENV=prod
Step 2/10 : FROM jwilder/dockerize:0.6.1 AS base
 ---> 849596ab86ff
Step 3/10 : RUN apk add --no-cache curl jq
 ---> Running in d6b9d0968be4
fetch <http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz>
WARNING: Ignoring <http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz>: temporary error (try again later)
fetch <http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz>
WARNING: Ignoring <http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz>: temporary error (try again later)
ERROR: unsatisfiable constraints:
  curl (missing):
    required by: world[curl]
  jq (missing):
    required by: world[jq]
The command '/bin/sh -c apk add --no-cache curl jq' returned a non-zero code: 2
m
@early-lamp-41924?
two issue here looks like; 1) quick start should not be trying to build any images and 2) it looks like while building it is missing curl and jq
actually the first issue might be preexisting 😕
we don't publish that image
e
Right. I think that is intentional
I’ll revert and figure this out
m
I wonder if you need to set docker buildkit? before taht dockerfile didn't need it
(check out dev.sh)
hmm, worked just now. @gentle-exabyte-43102 it did say it was a network / temporary error there in your logs, can you try again?
Copy code
Building elasticsearch-setup
Step 1/10 : ARG APP_ENV=prod
Step 2/10 : FROM jwilder/dockerize:0.6.1 AS base
 ---> 849596ab86ff
Step 3/10 : RUN apk add --no-cache curl jq
 ---> Running in b9d860d60149
fetch <http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz>
fetch <http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz>
(1/6) Installing ca-certificates (20161130-r3)
(2/6) Installing libssh2 (1.8.2-r0)
(3/6) Installing libcurl (7.61.1-r2)
(4/6) Installing curl (7.61.1-r2)
(5/6) Installing oniguruma (6.3.0-r0)
(6/6) Installing jq (1.5-r4)
...
g
strange. same error still.
m
are you on some corporate network or other firewall that is blocking that connection?
g
i'm in AWS on an Amazon Linux 2 ami
wget <http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz>
pulls down the tar just fine
i'm looking at
Copy code
ERROR: unsatisfiable constraints:
  curl (missing):
    required by: world[curl]
  jq (missing):
    required by: world[jq]
m
right before that it says
Copy code
---> Running in d6b9d0968be4
fetch <http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz>
WARNING: Ignoring <http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz>: temporary error (try again later)
i.e. it can't download the index of apks, so in turn it can't find jq and curl
g
ah, right
m
but your wget works...
deploying on AWS is not something I'm familiar with, won't be much help here, sorry
at least, I personally won't
g
no worries, appreciate your help here already
e
Should we separate the es dev part out of the docker-compose.dev.yml and create a new yml?
m
this isn't the dev flow
we don't publish the image at all, so regardless of dev/prod it has to be built. the log above is building it in the prod config, and it needs curl and jq, and for some reason it can't get the apks
e
got it
g
FYI the fix for getting
docker-compose up
to run on Amazon Linux 2 instance was to add
network: host
to the
build
at https://github.com/linkedin/datahub/blob/e7c3fd867b803f5d073bce51f6a2632b500309d0/docker/docker-compose.yml#L122
🙌 2