Hi Trying Dockerised Datahub in AWS env, as <@U026...
# all-things-deploymenth
handsome-football-66174
09/02/2021, 5:38 PMHi Trying Dockerised Datahub in AWS env, as @blue-holiday-20644 suggested. Using Postgres instead of mysql. Getting this error -
Trying the above with postgres rather than mysql-
unfortunately getting this - Any suggestions?
l
loud-island-88694
09/02/2021, 5:41 PM
@early-lamp-41924 ^
e
early-lamp-41924
09/02/2021, 6:24 PMCan you check the logs of these containers? Seems like schema-registry and mysql containers didn’t start up
h
handsome-football-66174
09/02/2021, 6:36 PMI see this error in gms container
@7l0c3p9nh - Internal server error, for (POST) [/api/v2/graphql] ->
play.api.UnexpectedException: Unexpected exception[CompletionException: java.net.ConnectException: Connection refused: datahub-gms/172.18.0.10:8080]
at play.api.http.HttpErrorHandlerExceptions$.throwableToUsefulException(HttpErrorHandler.scala:247)
at play.api.http.DefaultHttpErrorHandler.onServerError(HttpErrorHandler.scala:176)
at play.core.server.AkkaHttpServer$$anonfun$2.applyOrElse(AkkaHttpServer.scala:363)
at play.core.server.AkkaHttpServer$$anonfun$2.applyOrElse(AkkaHttpServer.scala:361)
handsome-football-66174
09/02/2021, 7:22 PM@early-lamp-41924 - Also how do we run each docker image on an ecs cluster?
e
early-lamp-41924
09/02/2021, 7:23 PMCan you run docker-compose commands?
early-lamp-41924
09/02/2021, 7:24 PMI usually do something like this from local
Copy code
COMPOSE_DOCKER_CLI_BUILD=1 DOCKER_BUILDKIT=1 docker-compose -p datahub -f quickstart/docker-compose-without-neo4j.quickstart.yml up -d --no-deps datahub-gmsearly-lamp-41924
09/02/2021, 7:24 PMbut for the above seems like gms is not the issue. gms doesn’t start up until kafka, mysql, and elasticsearch is up and ready
early-lamp-41924
09/02/2021, 7:25 PMSeems like mysql not spinning up well is causing gms to stall and then timeout
h
handsome-football-66174
09/02/2021, 7:29 PMunfortunately on the ecs cluster , we are able to only runs tasks using the docker image
e
early-lamp-41924
09/02/2021, 7:58 PMinteresting. so you put in the docker-compose files and ECS decides how to deploy?
h
handsome-football-66174
09/02/2021, 8:24 PMNo, I am using the docker compose file on an EC2 instance.
Still trying to figure out how to deploy datahub on ECS
e
early-lamp-41924
09/02/2021, 8:27 PMSo the above is a message from the EC2 instance? Did you find out why mysql did not start up?
early-lamp-41924
09/02/2021, 8:28 PMor are you using RDS instead of a local mysql instance here?
h
handsome-football-66174
09/03/2021, 1:49 PMYes, using RDS instance...
e
early-lamp-41924
09/03/2021, 4:39 PMBut you still have schema registry enabled in the docker-compose right?
early-lamp-41924
09/03/2021, 4:39 PMThen please use the quickstart.sh (or just copy the command its running)
early-lamp-41924
09/03/2021, 4:40 PMthe datahub cli checks for existence of these containers, so doesnt match youre use case