bland-orange-13353
06/20/2022, 1:17 PMhelpful-processor-71693
06/20/2022, 4:32 PMdatahub-datahub-gms
pod is failing with following error:
15:38:00.026 [main] ERROR o.s.web.context.ContextLoader:313 - Context initialization failed
org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'dataHubAuthorizerFactory': Unsatisfied dependency expressed through field 'entityClient'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'javaEntityClientFactory': Unsatisfied dependency expressed through field '_entityService'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'entityAspectDao' defined in com.linkedin.gms.factory.entity.EntityAspectDaoFactory: Unsatisfied dependency expressed through method 'createEbeanInstance' parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'ebeanServer' defined in com.linkedin.gms.factory.entity.EbeanServerFactory: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [io.ebean.EbeanServer]: Factory method 'createServer' threw exception; nested exception is java.lang.NullPointerException
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:659)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:639)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:119)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:399)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1431)
We are using AWS managed ES, MSK and RDS postgres instance for my datahub setup and i see following connection messages in gms pod so the connectivity between RDS looks fine
Also, my postgres setup job was completed without any issue.
Can someone help on this ?
2022/06/20 15:35:40 Waiting for: <https://xxxxxxxxxxxxxxxxx.es.amazonaws.com:443>
2022/06/20 15:35:40 Waiting for: <tcp://xxxxxxxxxxxxx.rds.amazonaws.com:5432>
2022/06/20 15:35:40 Waiting for: <tcp://xxxxxxx.amazonaws.com:9096>
2022/06/20 15:35:40 Waiting for: <tcp://xxxxxxxxx.us-west-2.amazonaws.com:9096>
2022/06/20 15:35:40 Waiting for: <tcp://xxxxxxxxx.us-west-2.amazonaws.com:9096>
2022/06/20 15:35:45 Connected to <tcp://xxxxxxxxx.us-west-2.amazonaws.com:9096>
2022/06/20 15:35:45 Connected to <tcp://xxxxxxxx.us-west-2.amazonaws.com:9096>
2022/06/20 15:35:45 Connected to <tcp://xxxxxxxxxxxx.us-west-2.amazonaws.com:9096>
2022/06/20 15:35:45 Connected to <tcp://xxxxxxxxxxxx.rds.amazonaws.com:5432>
2022/06/20 15:35:45 Received 200 from <https://xxxxxxxxxx.us-west-2.es.amazonaws.com:443>
sparse-barista-40860
06/20/2022, 9:54 PMsparse-barista-40860
06/20/2022, 9:54 PMsparse-barista-40860
06/20/2022, 10:30 PMsparse-barista-40860
06/20/2022, 10:30 PM/root/datahub/metadata-ingestion/examples/recipes/mysql_to_datahub.dhub.yaml
sparse-barista-40860
06/20/2022, 10:34 PMcalm-dinner-63735
06/22/2022, 9:21 AMcalm-dinner-63735
06/22/2022, 9:21 AMcalm-dinner-63735
06/22/2022, 10:20 AMbetter-orange-49102
06/22/2022, 10:48 AMable-rain-74449
06/22/2022, 11:22 AMhelm install datahub datahub/datahub --version 0.8.38
calm-dinner-63735
06/22/2022, 3:58 PMglobal.graph_service_impl = elasticsearch with 7.10
calm-dinner-63735
06/22/2022, 3:58 PMcalm-dinner-63735
06/22/2022, 3:58 PMcalm-dinner-63735
06/22/2022, 3:59 PMmicroscopic-breakfast-5726
06/22/2022, 6:06 PM- EBEAN_DATASOURCE_USERNAME=<<rds-username>>
- EBEAN_DATASOURCE_PASSWORD=<<rds-password>>
- EBEAN_DATASOURCE_HOST=<<rds-endpoint>>:3306
- EBEAN_DATASOURCE_URL=jdbc:mysql://<<rds-endpoint>>:3306/datahub?verifyServerCertificate=false&useSSL=true&useUnicode=yes&characterEncoding=UTF-8
- EBEAN_DATASOURCE_DRIVER=com.mysql.jdbc.Driver
great-toddler-2251
06/22/2022, 11:42 PMbitter-toddler-42943
06/23/2022, 2:25 AMlemon-terabyte-66903
06/23/2022, 11:51 PMlemon-terabyte-66903
06/24/2022, 2:46 PMbland-orange-13353
06/27/2022, 12:29 PMagreeable-belgium-70840
06/28/2022, 9:40 AMg.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'siblingAssociationHook' defined in URL [jar:file:/datahub/datahub-mae-consumer/bin/mae-consumer-job.jar!/BOOT-INF/lib/mae-consumer.jar!/com/linkedin/metadata/kafka/hook/siblings/SiblingAssociationHook.class]: Unsatisfied dependency expressed through constructor parameter 1; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'entityService' defined in class path resource [com/linkedin/gms/factory/entity/EntityServiceFactory.class]: 'entityService' depends on missing bean 'entityAspectDao'; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean named 'entityAspectDao' available
-------
Parameter 1 of constructor in com.linkedin.metadata.kafka.hook.siblings.SiblingAssociationHook required a bean named 'entityAspectDao' that could not be found.
The injection point has the following annotations:
- @javax.annotation.Nonnull(when=ALWAYS)
Any ideas?bulky-jackal-3422
06/28/2022, 3:25 PMlemon-terabyte-66903
06/28/2022, 4:16 PMcreamy-van-28626
06/28/2022, 6:20 PMnutritious-finland-99092
06/28/2022, 6:53 PMProblem with request: Get <http://localhost:9200>: dial tcp [::1]:9200: connect: connection refused. Sleeping 1s
Does anyone facing this issue or have deployed with ECS using elasticsearch and can help us?lemon-terabyte-66903
06/28/2022, 8:15 PMgreen-lion-58215
06/28/2022, 8:36 PMfrom datahub.ingestion.run.pipeline import Pipeline
pipeline = Pipeline.create(
{
"source": {
"type": "dbt",
"config": {
"manifest_path": "/tmp/manifest.json",
"catalog_path": "/tmp/catalog.json",
"sources_path": "/tmp/sources.json",
"target_platform": "databricks",
"load_schemas": True
},
},
"sink": {
"type": "datahub-rest",
"config": {"server": "http://<masked>:8080"},
},
}
)
some-kangaroo-13734
06/29/2022, 4:24 PM