Hi I'm deploying datahub on kubernetes. Deployment...
# all-things-deployment
b
Hi I'm deploying datahub on kubernetes. Deployment is getting stuck at this. Can someone help me with this
helm chart values
Copy code
# Values to start up datahub after starting up the datahub-prerequisites chart with "prerequisites" release name
# Copy this chart and change configuration as needed.
datahub-gms:
  enabled: true
  image:
    repository: linkedin/datahub-gms
    tag: "v0.8.20"
  resources:
    limits:
      cpu: 600m
      memory: 1024Mi
    requests:
      cpu: 600m
      memory: 1024Mi

datahub-frontend:
  enabled: true
  image:
    repository: linkedin/datahub-frontend-react
    tag: "v0.8.20"
  resources:
    limits:
      cpu: 100m
      memory: 750Mi
    requests:
      cpu: 100m
      memory: 750Mi
  # Set up ingress to expose react front-end
  ingress:
    enabled: false

datahub-mae-consumer:
  image:
    repository: linkedin/datahub-mae-consumer
    tag: "v0.8.20"

datahub-mce-consumer:
  image:
    repository: linkedin/datahub-mce-consumer
    tag: "v0.8.20"

datahub-ingestion-cron:
  enabled: false
  image:
    repository: acryldata/datahub-ingestion
    tag: "v0.8.20.0"

elasticsearchSetupJob:
  enabled: true
  image:
    repository: linkedin/datahub-elasticsearch-setup
    tag: "v0.8.20"
  extraEnvs:
    - name: USE_AWS_ELASTICSEARCH
      value: "true"

kafkaSetupJob:
  enabled: true
  image:
    repository: linkedin/datahub-kafka-setup
    tag: "v0.8.20"

mysqlSetupJob:
  enabled: true
  image:
    repository: acryldata/datahub-mysql-setup
    tag: "v0.8.20.0"

datahubUpgrade:
  enabled: true
  image:
    repository: acryldata/datahub-upgrade
    tag: "v0.8.20.0"
  noCodeDataMigration:
    sqlDbType: "MYSQL"

global:
  graph_service_impl: elasticsearch
  datahub_analytics_enabled: true
  datahub_standalone_consumers_enabled: false

  elasticsearch:
    host: "********"
    port: "443"
    useSSL: "true"

  kafka:
    bootstrap:
      server: "********"
    zookeeper:
      server: "***********"
    ## For AWS MSK set this to a number larger than 1
    partitions: 3
    # replicationFactor: 3
    schemaregistry:
      url: "*******************"
      # type: AWS_GLUE
      # glue:
      #   region: us-east-1
      #   registry: datahub

  neo4j:
    host: "prerequisites-neo4j-community:7474"
    uri: "<bolt://prerequisites-neo4j-community>"
    username: "neo4j"
    password:
      secretRef: neo4j-secrets
      secretKey: neo4j-password

  sql:
    datasource:
      host: "**************"
      hostForMysqlClient: "****************"
      port: "3306"
      url: "****************"
      driver: "com.mysql.cj.jdbc.Driver"
      username: "oyodbadmin"
      password:
        secretRef: mysql-secrets
        secretKey: mysql-root-password

  datahub:
    gms:
      port: "8080"
    mae_consumer:
      port: "9091"
    appVersion: "1.0"

#  hostAliases:
#    - ip: "192.168.0.104"
#      hostnames:
#        - "broker"
#        - "mysql"
#        - "elasticsearch"
#        - "neo4j"

##  Add below to enable SSL for kafka
#  credentialsAndCertsSecrets:
#    name: datahub-certs
#    path: /mnt/datahub/certs
#    secureEnv:
#      ssl.key.password: datahub.linkedin.com.KeyPass
#      ssl.keystore.password: datahub.linkedin.com.KeyStorePass
#      ssl.truststore.password: datahub.linkedin.com.TrustStorePass
#      kafkastore.ssl.truststore.password: datahub.linkedin.com.TrustStorePass
#
#  springKafkaConfigurationOverrides:
#    ssl.keystore.location: /mnt/datahub/certs/datahub.linkedin.com.keystore.jks
#    ssl.truststore.location: /mnt/datahub/certs/datahub.linkedin.com.truststore.jks
#    kafkastore.ssl.truststore.location: /mnt/datahub/certs/datahub.linkedin.com.truststore.jks
#    security.protocol: SSL
#    kafkastore.security.protocol: SSL
#    ssl.keystore.type: JKS
#    ssl.truststore.type: JKS
#    ssl.protocol: TLS
#    ssl.endpoint.identification.algorithm:
l
@early-lamp-41924 ^
e
hmn so
the main pods (not the setup jobs) are not spawning?
can you post the full
kubectl get pods
for the namespace?
b
Hi its working when i deploy using helm. Its not working when deploy through kubapps service
e
Ah. how are you porting the charts? It uses helm hooks to make sure the setup jobs run on each deploy and then the rest of the pods spawn.
b
@early-lamp-41924 Hooks are enabled only in setup and upgrade job there is no issue in deploying these. Subcharts are not getting installed in my case
e
hmn don’t have much experience working with kubeapps
is there some logs I can work off of?
Since the helm charts are deploying correctly through helm, not sure what we need to add to make kubeapps work
b
Hi Issue was resolved thanks for the help. issue: files are missing
e
Glad it worked out!