creamy-van-28626
05/24/2022, 4:39 PMprehistoric-salesclerk-23462
05/25/2022, 9:05 AMError: UPGRADE FAILED: error validating "": error validating data: unknown object type "nil" in Secret.data.token_service_salt
it runs fine when I execute manually from my console, this the command that I am using.
helm -n bi-datahub upgrade --install datahub datahub/datahub -f helm/charts/${ENV}/datahub.yaml
Help would be highly appreciated.delightful-barista-90363
05/26/2022, 8:53 PMbland-balloon-48379
05/26/2022, 9:28 PMkubectl create secret generic mysql-secrets --from-literal=mysql-root-password=datahub
However, I decided I wanted a more secure password for mysql so I uninstalled datahub & the prerequisites, recreated mysql-secrets with my new password, and even deleted the PVC for good measure (don't worry, there wasn't any data in it 😉). However, when I try to reinstall datahub-prerequisites, the mysql pod throws an error saying 'Access denied for user 'root'@'localhost' (using password: YES)'
. I've tried changing the password in case there was some character mysql didn't like, as well as deleting the PVCs for the other prereq items but no luck. However, when I change the password back to datahub like in the example it works fine again.
What is the process supposed to be for changing the mysql password? Is there something else that needs to be updated that I'm missing?
Any help would be appreciated. Thanks!curved-carpenter-44858
05/27/2022, 9:29 AMcreamy-van-28626
05/27/2022, 10:12 AMcreamy-van-28626
05/27/2022, 1:18 PMcreamy-van-28626
05/30/2022, 11:13 AMcreamy-van-28626
05/30/2022, 12:03 PMquaint-window-7517
05/30/2022, 7:13 PMworried-painting-70907
05/31/2022, 9:04 PMwooden-jackal-88380
05/31/2022, 9:37 PMdatahub-gms:
enabled: true
image:
repository: ${local.ecr_image_prefix}/linkedin/datahub-gms
tag: ${local.datahub_image_version}
serviceAccount:
create: true
name: "datahub-gms"
annotations:
<http://eks.amazonaws.com/role-arn|eks.amazonaws.com/role-arn>: ${module.iam_eks_role.iam_role_arn}
I tested that my service account works correctly by spinning up a test AWS CLI pod (last step in here: https://aws.amazon.com/premiumsupport/knowledge-center/eks-pods-iam-role-service-accounts/)
However, my datahub-gms pod is still crash looping and is still assuming my worker role, instead of my least privileged IAM role:
Caused by: software.amazon.awssdk.services.glue.model.AccessDeniedException: User: arn:aws:sts::XXX:assumed-role/mixed-1-node-group-20220530082254040100000001/i-08d04210802a93209 is not authorized to perform: glue:GetSchemaByDefinition on resource: arn:aws:glue:eu-west-3:XXX:registry/neo-datahub-kafka-pro because no identity-based policy allows the glue:GetSchemaByDefinition action (Service: Glue, Status Code: 400, Request ID: XXX)
I am wondering if anyone has encountered this before and if maybe the application doesn’t use the default credentials provider chain?best-umbrella-24804
06/01/2022, 2:13 AMmammoth-fountain-32989
06/01/2022, 1:48 PMbreezy-agent-56904
06/01/2022, 8:10 PMdatahub-gms:
livenessProbe:
initialDelaySeconds: 60
periodSeconds: 30
failureThreshold: 80
readinessProbe:
initialDelaySeconds: 60
periodSeconds: 30
failureThreshold: 80
Thanks in advance!quick-animal-47381
06/02/2022, 2:59 AMbridge
network mode) with 1 service and 1 task definition with multiple containers, and currently running into a problem where the containers are not able to communicate with each other via hostname (i.e. zookeeper:2181
). Since then we’ve tried using awsvpc
network mode and changed all the hostnames to localhost
, and while that solved the connectivity problems, there were further issues spinning up datahub-gms
and overall not sure if this is the right path forward. Please let me know, thank you!wonderful-jordan-36532
06/02/2022, 10:35 AMrapid-book-98432
06/02/2022, 12:12 PMminikube start --memory 16000 --cpus 6 --nodes 3 --driver=docker --forceStill having problem trying to deploy prerequisites :
helm install prerequisites datahub/datahub-prerequisites -n demo
bland-orange-13353
06/03/2022, 7:34 AMnumerous-camera-74294
06/03/2022, 12:01 PMbest-umbrella-24804
06/06/2022, 3:54 AMbreezy-controller-54597
06/06/2022, 8:06 AMbillions-morning-53195
06/06/2022, 3:40 PMkafka-setup-job
pod when configuring Datahub to work with SSL AWS MSK. Is there an example of how to create datahub-certs
secret on K8s? I found one for creating mysql and elasticsearch secrets in Datahub docs but not for SSL secrets for Kafka. If anyone could give me a sample snippet of how to create datahub-certs
secret would help a lot. Thanks in advance!billions-morning-53195
06/06/2022, 11:28 PMkafka-setup-job
to pickup SASL_SSL
related properties via Helm Chart, I am seeing this error -
[main] ERROR io.confluent.admin.utils.cli.KafkaReadyCommand - Error while running kafka-ready.
│ org.apache.kafka.common.KafkaException: Failed to create new KafkaAdminClient
│ at org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:535)
│ at org.apache.kafka.clients.admin.Admin.create(Admin.java:75)
│ at org.apache.kafka.clients.admin.AdminClient.create(AdminClient.java:49)
│ at io.confluent.admin.utils.ClusterStatus.isKafkaReady(ClusterStatus.java:138)
│ at io.confluent.admin.utils.cli.KafkaReadyCommand.main(KafkaReadyCommand.java:150)
│ Caused by: org.apache.kafka.common.KafkaException: javax.security.auth.login.LoginException: unable to find LoginModule class: software.amazon.msk.auth.iam.IAMLoginModule
│ at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:172)
│ at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:157)
│ at org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:73)
│ at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:105)
│ at org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:508)
billions-morning-53195
06/06/2022, 11:30 PMkafka-setup-job
container.bland-orange-13353
06/07/2022, 1:56 PMwonderful-dream-38059
06/07/2022, 2:46 PMrich-policeman-92383
06/08/2022, 8:36 AMastonishing-guitar-79208
06/08/2022, 4:46 PMjolly-journalist-19377
06/09/2022, 7:49 AM