abundant-policeman-24127
11/05/2021, 6:53 PMfancy-fireman-15263
11/08/2021, 5:15 PMabundant-policeman-24127
11/08/2021, 6:04 PMagreeable-hamburger-38305
11/08/2021, 7:18 PMElasticSearch
with Elastic Cloud
on GCP. Doing a PoC for my company and trying to see how easy/hard it would be to swap out the dependencies.silly-translator-73123
11/09/2021, 8:38 AMsilly-translator-73123
11/09/2021, 9:29 AMsilly-translator-73123
11/09/2021, 1:03 PMbrave-businessperson-3969
11/10/2021, 1:19 PMplain-farmer-27314
11/10/2021, 3:29 PMlimited-cricket-18852
11/11/2021, 12:41 PMboundless-student-48844
11/12/2021, 7:00 AMlinkedin/datahub-gms
linkedin/datahub-frontend-react
linkedin/datahub-mae-consumer
linkedin/datahub-mce-consumer
Do we run docker build
command with the corresponding Dockerfile?bland-salesmen-77140
11/12/2021, 11:30 AMboundless-student-48844
11/12/2021, 2:01 PMdatahub-gms
, but still got below error
13:54:26.103 [main] ERROR o.s.web.context.ContextLoader - Context initialization failed
org.springframework.context.ApplicationContextException: Failed to start bean 'org.springframework.kafka.config.internalKafkaListenerEndpointRegistry'; nested exception is java.lang.IllegalStateException: Topic(s) [MetadataChangeEvent_v4] is/are not present and missingTopicsFatal is true
at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:185)
at org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:53)
at org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:360)
at org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:158)
Do you have some idea?abundant-policeman-24127
11/12/2021, 6:34 PMadventurous-apple-98365
11/15/2021, 12:08 AMhead
container for GMS from Docker hub.
My ENVs are as follows on the container:
KAFKASTORE_SSL_TRUSTORE_LOCATION: foo
KAFKASTORE_SSL_TRUSTSORE_PASSWORD: bar
KAFKASTORE_SECURITY_PROTOCOL: SSL
KAFKASTORE_SSL_ENDPOINT_IDENTIFICATION_ALGORITHM: ""
I've also tried using a few variations of these envs (SCHEMA_REGISTRY, KAFKA
prefixes).
Any insight would be appreciated! Thanksrough-tent-62538
11/15/2021, 8:55 AMbrave-businessperson-3969
11/15/2021, 12:46 PMcool-xylophone-63884
11/15/2021, 5:15 PMboundless-scientist-520
11/16/2021, 11:02 AMenough-london-69397
11/16/2021, 7:36 PMWhile trying to ingest data from Athena, it doesnt find any table, I have double checked all the information and they are correct, can someonie help me with this?
millions-notebook-72121
11/17/2021, 4:06 PMregion
and name
- unless the name is the Glue schema registry ARN?nutritious-bird-77396
11/17/2021, 9:01 PM401
Error in datahub-gms
in trying to connect to OpenSearch
thru docker
Following are the env variables i am using...
ELASTICSEARCH_HOST=<http://xxxxxx.es.amazonaws.com|xxxxxx.es.amazonaws.com>
ELASTICSEARCH_PORT=443
ELASTICSEARCH_USERNAME=username
ELASTICSEARCH_PASSWORD=password
USE_AWS_ELASTICSEARCH=true
ELASTICSEARCH_USE_SSL=true
When debugging thru curl the call is successful when curl -u '<username:password>' '<https://xxxxxx.es.amazonaws.com:443>'
Where as from datahub-gms its trying to call as '<https://username:password@xxxxxx.es.amazonaws.com:443>'
Have anyone faced this before?nutritious-bird-77396
11/18/2021, 12:12 AMsome-cricket-23089
11/18/2021, 6:30 AMlimited-cricket-18852
11/18/2021, 4:54 PMelasticsearch.persistence.enabled: false
) , kafka(cp-helm-charts.cp-kafka.persistence.enabled: false
), zookeeper(cp-helm-charts.cp-zookeeper.persistence.enabled: false
) and mysql (mysql.primary.persistence.enabled: false
and mysql.secondary.persistence.enabled: false
) to simplify my deployment (we don’t support persistence on our k8s server yet ), but it still deploys statefulset:
NAME READY AGE
statefulset.apps/elasticsearch-master 0/2 12m
statefulset.apps/prerequisites-cp-kafka 0/3 12m
statefulset.apps/prerequisites-cp-zookeeper 0/1 12m
statefulset.apps/prerequisites-mysql 0/1 12m
Any idea how to totally disable persistence and statefulness ?some-cricket-23089
11/19/2021, 9:56 AMboundless-student-48844
11/19/2021, 2:08 PMv0.8.17
but encountered below error for frontend
and gms
pods when deploy over Helm. mae-consumer
and mce-consumer
pods run fine. Do you have some idea what goes wrong?
Error: dl failure on line 896
Error: failed /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so, because Error loading shared library libgcc_s.so.1: No such file or directory (needed by /usr/lib/libstdc++.so.6)
billions-twilight-48559
11/20/2021, 9:39 AM"datahub" has been added to your repositories
Hang tight while we grab the latest from your chart repositories...
...Successfully got an update from the "datahub" chart repository
Update Complete. ⎈Happy Helming!⎈
Error: failed to download "datahub/datahub-prerequisites" (hint: running `helm repo update` may help)
https://helm.datahubproject.io/ --> Navigation from the browser get a 404, but maybe that is normalsome-cricket-23089
11/22/2021, 10:51 AMStep 5/26: FROM --platform=$BUILDPLATFORM node:16.13.0alpline3.14 AS Prod-build
failed to parse platform : "" is invalid component of "":
Please suggest what is this $BUILDPLATFORM ARG is and should we add it in the Dockerfile ?handsome-football-66174
11/22/2021, 3:57 PM