Hello! we’re trying to upgrade to v0.13.0, and are stuck at the systemupdate job. It keeps failing to instantiate a kafka producer due to:

WARN [AnnotationConfigApplicationContext] Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'upgradeCli': Unsatisfied dependency expressed through field 'noCodeUpgrade': Error creating bean with name 'dataHubKafkaEventProducerFactory': Unsatisfied dependency expressed through field 'kafkaProducer': Error creating bean with name 'kafkaProducer' defined in class path resource [com/linkedin/gms/factory/kafka/DataHubKafkaProducerFactory.class]: Failed to instantiate [org.apache.kafka.clients.producer.Producer]: Factory method 'createInstance' threw exception with message: Failed to construct kafka producer
2024-03-13 13:30:24,459 [main] INFO io.ebean.datasource:755 - DataSourcePool [gmsEbeanServiceConfig] shutdown min[2] max[50] free[2] busy[0] waiting[0] highWaterMark[1] waitCount[0] hitCount[2] psc[hit:0 miss:0 put:0 rem:0]
ERROR [SpringApplication] Application run failed
org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'upgradeCli': Unsatisfied dependency expressed through field 'noCodeUpgrade': Error creating bean with name 'dataHubKafkaEventProducerFactory': Unsatisfied dependency expressed through field 'kafkaProducer': Error creating bean with name 'kafkaProducer' defined in class path resource [com/linkedin/gms/factory/kafka/DataHubKafkaProducerFactory.class]: Failed to instantiate [org.apache.kafka.clients.producer.Producer]: Factory method 'createInstance' threw exception with message: Failed to construct kafka producer

At the bottom I see this:

Caused by: java.lang.NoClassDefFoundError: software/amazon/awssdk/thirdparty/jackson/core/JsonFactory

But this feels like it would be a problem outside of configuration, any pointers? Our details FYI: • AWS MSK 3.6.0 • AWS_GLUE schema registry • AWS OpenSearch • kubernetes/helm deployment on EKS

Could be related to https://github.com/datahub-project/datahub/blob/master/datahub-upgrade/build.gradle#L73 - will investigate

that seems pretty much dead on!