https://datahubproject.io logo
Title
g

glamorous-spring-97970

05/25/2023, 11:29 AM
Hi Team, I am experiencing error on datahub-gms container. It keeps on showing 'unhealthy'. I've tried restarting the containers however, same issue again and again.
n

nutritious-salesclerk-57675

05/25/2023, 12:54 PM
Good day @glamorous-spring-97970 Do you have the metadata_service_authentication enabled? And is the datahub-datahub-system-update-job successful?
I had the same error earlier (I could be wrong about this. So pardon me if I am) and the root cause was that when you enable metadata_service_authentication, the system update job looks for the datahub_auth_secrets before the secrets is created. The workaround I used is 1. Deploy datahub with default values (metadata_service_authentication is disabled by default) 2. Upgrade your deployment with system update disabled and metadata_service_authentication enabled 3. Upgrade your deployment again with both metadata_service_authentication and system update enabled Hope this helps.
g

glamorous-spring-97970

05/26/2023, 11:27 AM
Hi @nutritious-salesclerk-57675 Thanks for replying. Tbh, I haven't enabled the "metadata_service_authentication". It's all default settings
n

nutritious-salesclerk-57675

05/26/2023, 11:27 AM
Good day @glamorous-spring-97970 Is your datahub-system-update-job successful?
g

glamorous-spring-97970

05/26/2023, 11:28 AM
Not sure, where is that ?
n

nutritious-salesclerk-57675

05/26/2023, 11:30 AM
Its part of the deployment. If you have deployed with k8s, you would be able to see it as a pod.
g

gentle-hamburger-31302

05/31/2023, 11:31 AM
@glamorous-spring-97970 are you still facing issue ?
g

glamorous-spring-97970

06/05/2023, 10:59 AM
Hi @gentle-hamburger-31302, I am again experiencing the same issue. One of the containers images (linkedin/datahub-gms:head) is unhealthy and I am unable to login to the Datahub tool.
g

gentle-hamburger-31302

06/05/2023, 11:00 AM
@incalculable-ocean-74010 Could you please look into
g

glamorous-spring-97970

06/05/2023, 11:03 AM
@incalculable-ocean-74010 -- FYI
g

gentle-hamburger-31302

06/05/2023, 11:04 AM
@glamorous-spring-97970 Could you please attach log of container
docker logs datahub-gms
g

glamorous-spring-97970

06/05/2023, 11:07 AM
DockerContainerDatahub-GMS-json.log
@gentle-hamburger-31302 - This one is the latest.
@gentle-hamburger-31302 - Any luck ?
i

incalculable-ocean-74010

06/05/2023, 8:57 PM
It looks like this deployment was done through DataHub cli using:
datahub docker quickstart
, in that case can you please run:
datahub docker quickstart --backup --backup-file datahub.sql
Then
datahub docker nuke --keep-data
Once that is done, please run:
datahub docker quickstart --version 0.10.3
This is to ensure you: 1.) Backup the data in the instance. 2.) Delete the running containers but not the state. 3.) Deploy DataHub on a stable version (not head)