creamy-van-28626
03/13/2023, 2:44 PMflat-painter-78331
03/14/2023, 6:07 AMmetrics_com_linkedin_metadata_kafka_MetadataChangeLogProcessor_maeProcess_Mean
metrics_com_linkedin_metadata_kafka_MetadataAuditEventsProcessor_maeProcess_75thPercentile
metrics_com_linkedin_metadata_kafka_MetadataAuditEventsProcessor_maeProcess_95thPercentile
Thanks!creamy-van-28626
03/14/2023, 2:35 PMbest-umbrella-88325
03/14/2023, 4:02 PMnachiket@LAPTOP-XXXXX:~$ kubectl logs -f datahub-elasticsearch-setup-job--1-dmwn4 -n datahub
2023/03/14 15:26:27 Waiting for: <https://XXXXXX.us-west-1.es.amazonaws.com:443>
2023/03/14 15:26:32 Received 200 from <https://XXXXXXX.us-west-1.es.amazonaws.com:443>
going to use protocol: https
going to use elastic headers based on username and password
not using any prefix
datahub_analytics_enabled: true
>>> GET _ilm/policy/datahub_usage_event_policy response code is 000
>>> failed to GET _ilm/policy/datahub_usage_event_policy ! -> exiting
Can someone help us with this please?
We are using v0.10.0 and chart version 0.2.154
Thanks in advancelimited-forest-73733
03/14/2023, 5:11 PMhappy-camera-26449
03/14/2023, 5:15 PMvictorious-spoon-76468
03/14/2023, 6:38 PMelasticsearch-setup-job
keeps returning the following error:
2023/03/14 18:16:12 Received 403 from https://<my_opensearch_endpoint>.<http://us-east-1.es.amazonaws.com:443|us-east-1.es.amazonaws.com:443>. Sleeping 1s
2023/03/14 18:16:13 Received 403 from https://<my_opensearch_endpoint>.<http://us-east-1.es.amazonaws.com:443|us-east-1.es.amazonaws.com:443>. Sleeping 1s
These are the chart values for ES:
elasticsearchSetupJob:
enabled: true
image:
repository: linkedin/datahub-elasticsearch-setup
tag: "v0.9.6"
podSecurityContext:
fsGroup: 1000
securityContext:
runAsUser: 1000
podAnnotations: {}
extraEnvs:
- name: USE_AWS_ELASTICSEARCH
value: "true"
- name: OPENSEARCH_USE_AWS_IAM_AUTH
value: "true"
serviceAccount: "datahub"
global:
elasticsearch:
host: "<my_opensearch_endpoint>.<http://us-east-1.es.amazonaws.com|us-east-1.es.amazonaws.com>"
port: "443"
useSSL: true
region: "us-east-1"
index:
enableMappingsReindex: true
enableSettingsReindex: true
upgrade:
cloneIndices: true
allowDocCountMismatch: false
Can someone help us with this, please?fierce-finland-15121
03/15/2023, 1:39 AMError: INSTALLATION FAILED: failed pre-install: timed out waiting for the condition
Looking around I saw some threads that implied the reason for this is likely a failure to start some pods during the prerequisite step. I ran kubectl get pods
and found one that was in fact in an error state
NAME READY STATUS RESTARTS AGE
datahub-datahub-system-update-job-wntk7 0/1 CreateContainerConfigError 0 5m14s
and when I describe the pod I see this warning event with the following description
Error: secret "datahub-auth-secrets" not found
According to the default values it seems that this secret should automatically be created in the namespace. Here is the relevant portion.
# Set to false if you'd like to provide your own auth secrets
provisionSecrets:
enabled: true
autoGenerate: true
# Only specify if autoGenerate set to false
# secretValues:
# secret: <secret value>
# signingKey: <signing key value>
# salt: <salt value>
I am guessing I can fix this by generating these secrets myself, but in reality I don't really care what they look like so I would prefer if the helm chart could just take care of it. Is there something that I am potentially missing or a reason why this secret isn't being created? As a followup if I need to create these secrets myself, what format/values are these expecting? Salt I can infer is just a 20 or so char salt string, but secret and signing key seem vague to me. Is the signing key supposed to be an rsa key or is it just any random string?bumpy-activity-74405
03/15/2023, 9:46 AMv0.10.0
(I am not using the provided helm charts):
1. Is it ok to upgrade to this version straight from v0.8.44
?
2. Is it ok to start datahub-upgrade
while the old version is running or should I stop the old instance first?
3. I see a tag v0.10.6
on dockerhub for the datahub-upgrade
image, should I use that one or stick with v0.10.0
?agreeable-belgium-70840
03/15/2023, 1:04 PMdatahub docker quickstart
But zookeeper is failing with the error below. What can I do?
[2023-03-15 10:35:38,353] INFO Reading configuration from: /etc/kafka/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2023-03-15 10:35:38,364] INFO clientPortAddress is 0.0.0.0:2181 (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2023-03-15 10:35:38,364] INFO secureClientPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2023-03-15 10:35:38,364] INFO observerMasterPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2023-03-15 10:35:38,365] INFO metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2023-03-15 10:35:38,367] INFO autopurge.snapRetainCount set to 3 (org.apache.zookeeper.server.DatadirCleanupManager)
[2023-03-15 10:35:38,368] INFO autopurge.purgeInterval set to 0 (org.apache.zookeeper.server.DatadirCleanupManager)
[2023-03-15 10:35:38,368] INFO Purge task is not scheduled. (org.apache.zookeeper.server.DatadirCleanupManager)
[2023-03-15 10:35:38,368] WARN Either no config or no quorum defined in config, running in standalone mode (org.apache.zookeeper.server.quorum.QuorumPeerMain)
[2023-03-15 10:35:38,370] INFO Log4j 1.2 jmx support not found; jmx disabled. (org.apache.zookeeper.jmx.ManagedUtil)
[2023-03-15 10:35:38,370] INFO Reading configuration from: /etc/kafka/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2023-03-15 10:35:38,371] INFO clientPortAddress is 0.0.0.0:2181 (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2023-03-15 10:35:38,371] INFO secureClientPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2023-03-15 10:35:38,371] INFO observerMasterPort is not set (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2023-03-15 10:35:38,371] INFO metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2023-03-15 10:35:38,371] INFO Starting server (org.apache.zookeeper.server.ZooKeeperServerMain)
[2023-03-15 10:35:38,389] INFO ServerMetrics initialized with provider org.apache.zookeeper.metrics.impl.DefaultMetricsProvider@46fa7c39 (org.apache.zookeeper.server.ServerMetrics)
[2023-03-15 10:35:38,394] INFO zookeeper.snapshot.trust.empty : false (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2023-03-15 10:35:38,395] ERROR Unable to access datadir, exiting abnormally (org.apache.zookeeper.server.ZooKeeperServerMain)
org.apache.zookeeper.server.persistence.FileTxnSnapLog$DatadirException: Cannot write to data directory /var/lib/zookeeper/log/version-2
at org.apache.zookeeper.server.persistence.FileTxnSnapLog.<init>(FileTxnSnapLog.java:140)
at org.apache.zookeeper.server.ZooKeeperServerMain.runFromConfig(ZooKeeperServerMain.java:137)
at org.apache.zookeeper.server.ZooKeeperServerMain.initializeAndRun(ZooKeeperServerMain.java:112)
at org.apache.zookeeper.server.ZooKeeperServerMain.main(ZooKeeperServerMain.java:67)
at org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:140)
at org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:90)
square-solstice-69079
03/15/2023, 1:46 PMFailed to perform post authentication steps. Error message: Failed to provision user with urn urn:li:corpuser:myname@domain.com.
rich-salesmen-77587
03/15/2023, 2:57 PMcuddly-arm-8412
03/16/2023, 1:53 AMgreat-monkey-52307
03/16/2023, 10:03 PMgreat-toddler-2251
03/17/2023, 12:01 AMAUTH_OIDC_SCOPE: openid profile email groups
AUTH_OIDC_EXTRACT_GROUPS_ENABLED: true
Any debugging suggestions?microscopic-leather-94537
03/17/2023, 10:01 AMbreezy-honey-91751
03/17/2023, 8:50 PMcreamy-van-28626
03/20/2023, 7:50 AMgifted-diamond-19544
03/20/2023, 10:11 AMDATAHUB_SERVER_TYPE
on the GMS container? What are the possible values for this, and what impact do the various options have? On the quickstart docker-compose this comes set as quickstart
, what is the impact of this and should we change it when we deploy it? Thank you!brief-oyster-50637
03/20/2023, 2:21 PMcuddly-plumber-64837
03/20/2023, 3:24 PMagreeable-park-13466
03/20/2023, 9:11 PMCOPY ./datahub-frontend ./datahub-src/datahub-frontend
COPY ./entity-registry ./datahub-src/entity-registry
COPY ./buildSrc ./datahub-src/buildSrc
COPY ./datahub-web-react ./datahub-src/datahub-web-react
COPY ./li-utils ./datahub-src/li-utils
COPY ./metadata-models ./datahub-src/metadata-models
COPY ./metadata-auth ./datahub-src/metadata-auth
COPY ./metadata-dao-impl ./datahub-src/metadata-dao-impl
COPY ./metadata-events ./datahub-src/metadata-events
COPY ./metadata-ingestion ./datahub-src/metadata-ingestion
COPY ./metadata-ingestion-modules ./datahub-src/metadata-ingestion-modules
COPY ./metadata-integration ./datahub-src/metadata-integration
COPY ./metadata-io ./datahub-src/metadata-io
COPY ./metadata-jobs ./datahub-src/metadata-jobs
COPY ./metadata-models ./datahub-src/metadata-models
COPY ./metadata-models-custom ./datahub-src/metadata-models-custom
COPY ./metadata-models-validator ./datahub-src/metadata-models-validator
COPY ./metadata-service ./datahub-src/metadata-service
COPY ./metadata-utils ./datahub-src/metadata-utils
COPY ./datahub-graphql-core ./datahub-src/datahub-graphql-core
COPY ./gradle ./datahub-src/gradle
COPY repositories.gradle gradle.properties gradlew settings.gradle build.gradle ./datahub-src/
RUN chmod -R 755 ./datahub-src
#RUN ./datahub-src/gradlew build
RUN cd datahub-src \
&& ./gradlew :datahub-web-react:build -x test -x yarnTest -x yarnLint \
&& ./gradlew :datahub-frontend:dist -PuseSystemNode=${USE_SYSTEM_NODE} -x test -x yarnTest -x yarnLint \
&& ls -l datahub-frontend/build/distributions \
&& cp datahub-frontend/build/distributions/datahub-frontend.zip ../datahub-frontend.zip \
&& cd .. && rm -rf datahub-src && unzip datahub-frontend.zip
./gradlew :datahub-frontend:dist -PuseSystemNode=${USE_SYSTEM_NODE} -x test -x yarnTest -x yarnLint is getting completed successfully
but cp datahub-frontend/build/distributions/datahub-frontend.zip ../datahub-frontend.zip is getting failed with below error.
cp: can't stat 'datahub-frontend/build/distributions/datahub-frontend.zip': No such file or directory
below is the list of files present in datahub-frontend/build/distributions:
-rw-r--r-- 1 root root 186757120 Mar 20 20:30 datahub-frontend-0.0.0-unknown-SNAPSHOT.tar
-rw-r--r-- 1 root root 170932974 Mar 20 20:30 datahub-frontend-0.0.0-unknown-SNAPSHOT.zip
-rw-r--r-- 1 root root 186767360 Mar 20 20:30 main-0.0.0-unknown-SNAPSHOT.tar
-rw-r--r-- 1 root root 170930013 Mar 20 20:30 main-0.0.0-unknown-SNAPSHOT.zip
-rw-r--r-- 1 root root 186777600 Mar 20 20:30 playBinary-0.0.0-unknown-SNAPSHOT.tar
-rw-r--r-- 1 root root 170938889 Mar 20 20:31 playBinary-0.0.0-unknown-SNAPSHOT.zip
Can anyone help on this.
Attached dockerfile for reference.rich-salesmen-77587
03/20/2023, 11:33 PMcreamy-van-28626
03/21/2023, 5:28 PMcreamy-van-28626
03/21/2023, 5:29 PMhappy-baker-8735
03/22/2023, 9:17 AMlimited-forest-73733
03/22/2023, 12:17 PMcreamy-van-28626
03/22/2023, 12:31 PMwhite-guitar-82227
03/22/2023, 12:46 PMbrash-caravan-14114
03/22/2023, 2:37 PMbrash-caravan-14114
03/22/2023, 2:37 PMlively-cat-88289
03/22/2023, 2:37 PM