Hi 👋! I’m running DataHub

v0.9.6

and I’m getting the following error in `datahub-gms`:

Caught exception while executing bootstrap step IngestRolesStep. Continuing...
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms com.amazonaws.services.schemaregistry.exception.AWSSchemaRegistryException: Exception occurred while fetching or registering schema definition = {"type":"record","name":"MetadataChangeLog","namespace":"com.linkedin.pegasus2avro.mxe","doc":"Kafka event for capturing update made to an entity's metadata.","fields":[{"name":"auditHeader","type":["null",{"type":
...
...
:"An audit stamp detailing who and when the aspect was changed by. Required for all intents and purposes.","default":null}]}, schema name = MetadataChangeLog_Versioned_v1
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.amazonaws.services.schemaregistry.common.SchemaByDefinitionFetcher.getORRegisterSchemaVersionId(SchemaByDefinitionFetcher.java:99)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.amazonaws.services.schemaregistry.serializers.GlueSchemaRegistrySerializationFacade.getOrRegisterSchemaVersion(GlueSchemaRegistrySerializationFacade.java:86)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.amazonaws.services.schemaregistry.serializers.GlueSchemaRegistryKafkaSerializer.serialize(GlueSchemaRegistryKafkaSerializer.java:113)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at org.apache.kafka.common.serialization.Serializer.serialize(Serializer.java:62)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at org.apache.kafka.clients.producer.KafkaProducer.doSend(KafkaProducer.java:902)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at org.apache.kafka.clients.producer.KafkaProducer.send(KafkaProducer.java:862)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.linkedin.metadata.dao.producer.KafkaEventProducer.produceMetadataChangeLog(KafkaEventProducer.java:114)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.linkedin.metadata.entity.EntityService.produceMetadataChangeLog(EntityService.java:1286)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.linkedin.metadata.entity.EntityService.produceMetadataChangeLog(EntityService.java:1311)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.linkedin.metadata.boot.steps.IngestRolesStep.ingestRole(IngestRolesStep.java:111)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.linkedin.metadata.boot.steps.IngestRolesStep.execute(IngestRolesStep.java:79)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.linkedin.metadata.boot.BootstrapManager.lambda$start$0(BootstrapManager.java:44)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1736)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at java.base/java.lang.Thread.run(Thread.java:829)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms Caused by: com.amazonaws.services.schemaregistry.exception.AWSSchemaRegistryException: Failed to get schemaVersionId by schema definition for schema name = MetadataChangeLog_Versioned_v1
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.amazonaws.services.schemaregistry.common.AWSSchemaRegistryClient.getSchemaVersionIdByDefinition(AWSSchemaRegistryClient.java:148)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.amazonaws.services.schemaregistry.common.SchemaByDefinitionFetcher$SchemaDefinitionToVersionCache.load(SchemaByDefinitionFetcher.java:110)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.amazonaws.services.schemaregistry.common.SchemaByDefinitionFetcher$SchemaDefinitionToVersionCache.load(SchemaByDefinitionFetcher.java:106)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3529)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2278)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2155)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2045)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.google.common.cache.LocalCache.get(LocalCache.java:3951)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:3974)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4935)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.amazonaws.services.schemaregistry.common.SchemaByDefinitionFetcher.getORRegisterSchemaVersionId(SchemaByDefinitionFetcher.java:74)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	... 15 common frames omitted
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms Caused by: software.amazon.awssdk.services.glue.model.AccessDeniedException: User: arn:aws:sts::277977467804:assumed-role/eks-node-iam-role/XXXX is not authorized to perform: glue:GetSchemaByDefinition on resource: arn:aws:glue:us-east-1:XXXXXXX:registry/default-registry because no identity-based policy allows the glue:GetSchemaByDefinition action (Service: Glue, Status Code: 400, Request ID: 7df19e37-f1f8-40ab-9032-d24796a3972b)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.CombinedResponseHandler.handleErrorResponse(CombinedResponseHandler.java:125)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.CombinedResponseHandler.handleResponse(CombinedResponseHandler.java:82)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.CombinedResponseHandler.handle(CombinedResponseHandler.java:60)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.CombinedResponseHandler.handle(CombinedResponseHandler.java:41)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.pipeline.stages.HandleResponseStage.execute(HandleResponseStage.java:40)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.pipeline.stages.HandleResponseStage.execute(HandleResponseStage.java:30)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptTimeoutTrackingStage.execute(ApiCallAttemptTimeoutTrackingStage.java:73)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptTimeoutTrackingStage.execute(ApiCallAttemptTimeoutTrackingStage.java:42)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.pipeline.stages.TimeoutExceptionHandlingStage.execute(TimeoutExceptionHandlingStage.java:78)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.pipeline.stages.TimeoutExceptionHandlingStage.execute(TimeoutExceptionHandlingStage.java:40)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptMetricCollectionStage.execute(ApiCallAttemptMetricCollectionStage.java:50)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptMetricCollectionStage.execute(ApiCallAttemptMetricCollectionStage.java:36)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:81)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:36)
...
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	at com.amazonaws.services.schemaregistry.common.AWSSchemaRegistryClient.getSchemaVersionIdByDefinition(AWSSchemaRegistryClient.java:144)
datahub-datahub-gms-5ff98bf459-st6pn datahub-gms 	... 25 common frames omitted

It’s like it’s trying to access to AWS Glue instead of Schema registry and I have set up schema registry in global variables. Any ideas 🙏?

Hi, we can’t provide a lot of guidance on these older versions- updating to a more recent one may help resolve this issue for you

Hy @astonishing-answer-96712. I’ve upgraded DataHub to the latest version and the issue is gone! 🎉 Thanks!!