.Hi Team,
MCE Issue:
Earlier when we were upgrading to 0.10.4 version we were getting Error creating bean with name 'awsGlueSchemaRegistryFactory': Injection of autowired dependencies failed; nested exception is java.lang.IllegalArgumentException: Could not resolve placeholder 'kafka.schemaRegistry.awsGlue.region' in value "${kafka.schemaRegistry.awsGlue.region}", as suggested in tuesday breakout session we downgraded to 0.10.3 version Now we are getting below error":
2023-09-01 11
4537,439 [main] WARN o.eclipse.jetty.webapp.WebAppContext - Failed startup of context o.s.b.w.e.j.JettyEmbeddedWebAppContext@758e6acd{application,/,[file:///tmp/jetty-docbase.9090.3581628884752846733/],UNAVAILABLE}
org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'restliServletRegistration' defined in class path resource [com/linkedin/metadata/restli/RestliServletConfig.class]: Unsatisfied dependency expressed through method 'restliServletRegistration' parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'restliHandlerServlet': Unsatisfied dependency expressed through field '_r2Servlet'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'rapServlet' defined in class path resource [com/linkedin/restli/server/RAPServletFactory.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.linkedin.r2.transport.http.server.RAPServlet]: Factory method 'rapServlet' threw exception; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'authorizerChainFactory': Unsatisfied dependency expressed through field 'dataHubAuthorizer'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'dataHubAuthorizerFactory': Unsatisfied dependency expressed through field 'entityClient'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'javaEntityClientFactory': Unsatisfied dependency expressed through field '_entityService'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'entityAspectDao' defined in class path resource [com/linkedin/gms/factory/entity/EntityAspectDaoFactory.class]: Unsatisfied dependency expressed through method 'createEbeanInstance' parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'ebeanServer' defined in class path resource [com/linkedin/gms/factory/entity/EbeanServerFactory.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [io.ebean.EbeanServer]: Factory method 'createServer' threw exception; nested exception is java.lang.NullPointerException
Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'restliHandlerServlet': Unsatisfied dependency expressed through field '_r2Servlet'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'rapServlet' defined in class path resource [com/linkedin/restli/server/RAPServletFactory.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.linkedin.r2.transport.http.server.RAPServlet]: Factory method 'rapServlet' threw exception; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'authorizerChainFactory': Unsatisfied dependency expressed through field 'dataHubAuthorizer'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'dataHubAuthorizerFactory': Unsatisfied dependency expressed through field 'entityClient'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'javaEntityClientFactory': Unsatisfied dependency expressed through field '_entityService'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'entityAspectDao' defined in class path resource [com/linkedin/gms/factory/entity/EntityAspectDaoFactory.class]: Unsatisfied dependency expressed through method 'createEbeanInstance' parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'ebeanServer' defined in class path resource [com/linkedin/gms/factory/entity/EbeanServerFactory.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [io.ebean.EbeanServer]: Factory method 'createServer' threw exception; nested exception is java.lang.NullPointerException
For GMS:
Suppressed: org.elasticsearch.client.ResponseException: method [POST], host [
https://url:443], URI [/datahubpolicyindex_v2/_search?typed_keys=true&max_concurrent_shard_requests=5&ignore_unavailable=false&expand_wildcards=open&allow_no_indices=true&ignore_throttled=true&search_type=query_then_fetch&batched_reduce_size=512&ccs_minimize_roundtrips=true], status line [HTTP/1.1 400 Bad Request]
{"error":{"root_cause":[{"type":"query_shard_exception","reason":"No mapping found for [lastUpdatedTimestamp] in order to sort on","index_uuid":"xyz","index":"datahubpolicyindex_v2"}],"type":"search_phase_execution_exception","reason":"all shards failed","phase":"can_match","grouped":true,"failed_shards":[{"shard":0,"index":"datahubpolicyindex_v2","node":"UpzpcqaERpuGr-3NwBZoIQ","reason":{"type":"query_shard_exception","reason":"No mapping found for [lastUpdatedTimestamp] in order to sort on","index_uuid":"xyz","index":"datahubpolicyindex_v2"}}]},"status":400}
at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:326)
at org.elasticsearch.client.RestClient.performRequest(RestClient.java:296)
at org.elasticsearch.client.RestClient.performRequest(RestClient.java:270)
at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1632)
... 17 common frames omitted
2023-09-01 11
5422,710 [pool-11-thread-1] ERROR c.d.authorization.DataHubAuthorizer:230 - Failed to retrieve policy urns! Skipping updating policy cache until next refresh. start: 0, count: 30
com.datahub.util.exception.ESQueryException: Search query failed:
2023-09-01 11
5422,836 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry
2023-09-01 11
5422,837 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5423,838 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry
2023-09-01 11
5423,838 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5424,839 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry
2023-09-01 11
5424,839 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5425,841 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry
2023-09-01 11
5425,841 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5426,842 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry
2023-09-01 11
5426,842 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5427,848 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry: Name does not resolve
2023-09-01 11
5427,849 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5422,836 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry
2023-09-01 11
5422,837 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5423,838 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry
2023-09-01 11
5423,838 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5424,839 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry
2023-09-01 11
5424,839 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5425,841 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry
2023-09-01 11
5425,841 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5426,842 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry
2023-09-01 11
5426,842 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5427,848 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:68 - Failed to connect to open servlet: schema-registry: Name does not resolve
2023-09-01 11
5427,849 [pool-14-thread-1] INFO c.l.m.boot.OnBootApplicationListener:60 - Sleeping for 1 second
2023-09-01 11
5422,710 [pool-11-thread-1] ERROR c.d.authorization.DataHubAuthorizer:230 - Failed to retrieve policy urns! Skipping updating policy cache until next refresh. start: 0, count: 30
com.datahub.util.exception.ESQueryException: Search query failed:
2023-09-01 11
5417,888 [pool-17-thread-1] ERROR c.l.g.factory.telemetry.DailyReport:115 - Error reporting telemetry:
javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at java.base/sun.security.ssl.Alert.createSSLException(Alert.java:131)
Could anyone please have a look and assist us its blocking us now?