wooden-football-7175
07/13/2022, 6:33 PMkafka
?faint-translator-23365
07/13/2022, 8:27 PMfew-grass-66826
07/14/2022, 1:55 PMelegant-evening-28502
07/14/2022, 5:47 PMkafkaSetupJob
, getting below error
[kafka-admin-client-thread | adminclient-1] INFO org.apache.kafka.common.utils.AppInfoParser - App info kafka.admin.client for adminclient-1 unregistered
[kafka-admin-client-thread | adminclient-1] INFO org.apache.kafka.clients.admin.internals.AdminMetadataManager - [AdminClient clientId=adminclient-1] Metadata update failed
[main] ERROR io.confluent.admin.utils.ClusterStatus - Error while getting broker list.
org.apache.kafka.common.errors.TimeoutException: Call(callName=fetchMetadata, deadlineMs=1657820045949, tries=1, nextAllowedTryMs=-9223372036854775709) timed out at 9223372036854775807 after 1 attempt(s)
Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting to send the call. Call: fetchMetadata
creamy-van-28626
07/14/2022, 6:33 PMcreamy-van-28626
07/15/2022, 7:27 AMbland-orange-13353
07/15/2022, 7:56 PMnumerous-tent-25319
07/16/2022, 11:32 AMdatahub-datahub-gms
not able to connect with elasticsearch. Getting following error in the log
2022/07/16 11:25:03 Received 403 from <https://vpc--datahubes-vsqu3edgv5tsiyshvnq.ap-south-1.es.amazonaws.com:443>. Sleeping 1s
2022/07/16 11:25:04 Received 403 from <https://vpc-datahubes-vsqu3edgv5tsiyshvnq.ap-south-1.es.amazonaws.com:443>. Sleeping 1s
While we have attached the serviceAccount with the pods and the AWS IAM role is also whitelisted in the resource policy with proper permission.
I want to confirm that does datahub support AWS signature version 4 to make connection with AWS elasticsearch.few-grass-66826
07/18/2022, 10:47 AMstocky-midnight-78204
07/18/2022, 12:43 PMstocky-midnight-78204
07/18/2022, 12:43 PMstocky-midnight-78204
07/18/2022, 12:43 PMstocky-midnight-78204
07/18/2022, 12:44 PMstocky-midnight-78204
07/18/2022, 12:49 PMlemon-terabyte-66903
07/18/2022, 4:10 PMelegant-evening-28502
07/18/2022, 7:41 PMpostgresqlSetupJob
is failing to start, the username(dev_datahub_app_user) is passed as database name. Below is the error
psql: error: connection to server at "<http://dev-datahub.cluster-cbcjxpl7jfef.us-east-1.rds.amazonaws.com|dev-datahub.cluster-cbcjxpl7jfef.us-east-1.rds.amazonaws.com>" (10.26.203.144), port 5432 failed: FATAL: database "dev_datahub_app_user" does not exit
psql: error: connection to server at "<http://dev-datahub.cluster-cbcjxpl7jfef.us-east-1.rds.amazonaws.com|dev-datahub.cluster-cbcjxpl7jfef.us-east-1.rds.amazonaws.com>" (10.26.203.144), port 5432 failed: FATAL: database "datahub" does not exist
2022/07/18 19:14:57 Command exited with error: exit status 2
faint-translator-23365
07/18/2022, 7:52 PMhappy-twilight-91685
07/19/2022, 1:05 AMstocky-midnight-78204
07/19/2022, 1:33 AMhallowed-machine-2603
07/19/2022, 6:08 AMproud-lamp-13920
07/19/2022, 6:54 AMAUTH_OIDC_ENABLED=true
AUTH_OIDC_CLIENT_ID=your-client-id
AUTH_OIDC_CLIENT_SECRET=your-client-secret
AUTH_OIDC_DISCOVERY_URI=<https://accounts.google.com/.well-known/openid-configuration>
AUTH_OIDC_BASE_URL=your-datahub-url
AUTH_OIDC_SCOPE="openid profile email"
AUTH_OIDC_USER_NAME_CLAIM=email
AUTH_OIDC_USER_NAME_CLAIM_REGEX=([^@]+)
So, i have two question.
First, many yaml file exist In GKE.
Which yaml file do i need to edit in GKE menu?
service in "Services and Ingress" or deployment in "Workloads"?
Second, where should i add "extraEnvs" in yaml file?
Thankscuddly-arm-8412
07/19/2022, 12:03 PMcolossal-needle-73093
07/19/2022, 12:29 PMcolossal-needle-73093
07/19/2022, 12:38 PMcolossal-needle-73093
07/19/2022, 12:42 PMHi, esError: Could not find or load main class "-Xms256m
Caused by: java.lang.ClassNotFoundException: "-Xms256m
Exception in thread "main" java.lang.RuntimeException: starting java failed with [1]
output:
error:
at org.elasticsearch.tools.launchers.JvmErgonomics.flagsFinal(JvmErgonomics.java:126)
at org.elasticsearch.tools.launchers.JvmErgonomics.finalJvmOptions(JvmErgonomics.java:88)
at org.elasticsearch.tools.launchers.JvmErgonomics.choose(JvmErgonomics.java:59)
at org.elasticsearch.tools.launchers.JvmOptionsParser.jvmOptions(JvmOptionsParser.java:137)
at org.elasticsearch.tools.launchers.JvmOptionsParser.main(JvmOptionsParser.java:95)
few-grass-66826
07/19/2022, 1:25 PMable-evening-90828
07/19/2022, 6:02 PMdocker/dev.sh
, I got the following error. It looks like the debug
tag no longer exists for the image.
Error response from daemon: manifest for linkedin/datahub-kafka-setup:debug not found: manifest unknown: manifest unknown
https://hub.docker.com/r/linkedin/datahub-kafka-setup/tags?page=1&name=debug
I found that the debug
tag is also missing for datahub-frontend-react
and datahub-elasticsearch-setup
images.
Does anyone know how to work around this?creamy-van-28626
07/19/2022, 6:49 PMcuddly-arm-8412
07/20/2022, 1:01 AMcolossal-needle-73093
07/20/2022, 4:20 AM