Hey folks ! I still have some issue trying to depl...
# all-things-deploymentr
rapid-book-98432
09/01/2022, 10:29 AMHey folks ! I still have some issue trying to deploy the helm chart on minikube... Having permission denied issue for bitnami mysql service. If anyone here succeeded to install it... Some help will be appreciated :') !
b
bumpy-needle-3184
09/01/2022, 12:59 PMcould you share the error and logs
r
rapid-book-98432
09/02/2022, 10:06 AMHello @bumpy-needle-3184, here was mi first message about it : https://datahubspace.slack.com/archives/CV2UVAPPG/p1654175848914959?thread_ts=1654171932.028479&cid=CV2UVAPPG
b
bumpy-needle-3184
09/02/2022, 10:25 AMcould you try running beow command
helm install prerequisites datahub/datahub-prerequisites --set kafka.volumePermissions.enabled=true --set kafka.zookeeper.volumePermissions.enabled=true -n demo --debugr
rapid-book-98432
09/02/2022, 10:28 AMWell, since yesterday i'm trying to use microk8s instead of minikube
rapid-book-98432
09/02/2022, 10:29 AMcould be microk8s fault now
rapid-book-98432
09/02/2022, 10:29 AMnever had this one with minikube
b
bumpy-needle-3184
09/02/2022, 10:30 AMyes , the command i shared was for permission issue in minikube
r
rapid-book-98432
09/02/2022, 10:32 AMOk let me try using minikube cluster
rapid-book-98432
09/02/2022, 10:32 AMstrange thin is the helm deployment working good on Azure AKS Cluster
rapid-book-98432
09/02/2022, 10:33 AMdo you advise me minikue over microk8s ?
b
bumpy-needle-3184
09/02/2022, 10:33 AMyes please
r
rapid-book-98432
09/02/2022, 10:34 AMhere we go i test with minikube
rapid-book-98432
09/02/2022, 11:03 AMwith this as options :
--set mysql.volumePermissions.enabled=true --set kafka.volumePermissions.enabled=true --set kafka.zookeeper.volumePermissions.enabled=true
b
bumpy-needle-3184
09/02/2022, 11:16 AMIn order to properly support the required persistent volume claims for the Elasticsearch StatefulSet, the
default-storageclassstorage-provisionerr
rapid-book-98432
09/02/2022, 11:17 AMlet me try, untill now having this one :
ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];
Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
rapid-book-98432
09/02/2022, 11:17 AMthx
b
bumpy-needle-3184
09/02/2022, 11:19 AMand then run
helm upgrade --install prerequisites datahub/datahub-prerequisites -n <namespace>r
rapid-book-98432
09/02/2022, 11:19 AMwell i did uninstall š my bad
b
bumpy-needle-3184
09/02/2022, 11:20 AMthis time try without using any --set option
r
rapid-book-98432
09/02/2022, 11:20 AMokay
rapid-book-98432
09/02/2022, 11:30 AMWell still issue with ES ans kafka
rapid-book-98432
09/02/2022, 11:30 AMand schema registry
b
bumpy-needle-3184
09/02/2022, 11:30 AMwhat is the error ?
r
rapid-book-98432
09/02/2022, 11:31 AMFor kafka :
kafka.common.InconsistentClusterIdException: The Cluster ID 5FeW5yMdQk60_3xwFtoxpw doesn't match stored clusterId Some(re7FV8x2S9WPZlxDzBPHMw) in meta.properties. The broker is trying to join the wrong cluster. Configured zookeeper.connect may be wrong.
at kafka.server.KafkaServer.startup(KafkaServer.scala:218)
at kafka.Kafka$.main(Kafka.scala:109)
at kafka.Kafka.main(Kafka.scala)
rapid-book-98432
09/02/2022, 11:32 AMFor ES :
ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];
Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)
b
bumpy-needle-3184
09/02/2022, 11:42 AMTry these steps -
ā¢ helm uninstall prerequisites -n demo
ā¢ docker volume prune
ā¢ helm upgrade --install prerequisites datahub/datahub-prerequisites --set elasticsearch.securityContext.privileged=true --set elasticsearch.securityContext.runAsUser=0 --set kafka.volumePermissions.enabled=true --set kafka.zookeeper.volumePermissions.enabled=true -n demo
r
rapid-book-98432
09/02/2022, 11:46 AMwell thanks again i try this
rapid-book-98432
09/02/2022, 11:54 AMWarning Failed 2m15s (x11 over 4m9s) kubelet Error: container's runAsUser breaks non-root policy (pod: "elasticsearch-master-0_duke-demo1(8bf6a93e-c0e1-4ddd-ba4e-f901ce18bbf1)", container: elasticsearch)
rapid-book-98432
09/02/2022, 11:58 AM[2022-09-02 115735,317] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
kafka.common.InconsistentClusterIdException: The Cluster ID 1bcbnrhES-C1xEwRYNeZSg doesn't match stored clusterId Some(re7FV8x2S9WPZlxDzBPHMw) in meta.properties. The broker is trying to join the wrong cluster. Configured zookeeper.connect may be wrong.
at kafka.server.KafkaServer.startup(KafkaServer.scala:218)
at kafka.Kafka$.main(Kafka.scala:109)
at kafka.Kafka.main(Kafka.scala)Started again without any options
rapid-book-98432
09/02/2022, 12:54 PMWell we can see it's quite more complicated than this tutorial : https://datahubproject.io/docs/deploy/kubernetes
š at least for me
rapid-book-98432
09/02/2022, 1:09 PMBy the way i start my minikue as is :
minikube start --memory 12288 --cpus 6 --nodes 3 --driver=docker --force
rapid-book-98432
09/02/2022, 1:09 PMMaybe i should remove the driver
rapid-book-98432
09/02/2022, 1:09 PMdocker*
5 Views