Hi folks I am trying to setup Datahub on EKS via helm using AWS managed services for pre-requisites. https://datahubproject.io/docs/deploy/aws#aws-glue-schema-registry My Elasticsetup, Kafkasetup and MySQLsetup jobs ran fine but the datahub-system-update job is failing and it complains

Caused by: java.lang.IllegalArgumentException: Could not resolve placeholder 'kafka.schemaRegistry.awsGlue.region' in value "${kafka.schemaRegistry.awsGlue.region}"

This is my corresponding section in

values.yaml

kafka:
    bootstrap:
      server: "b-2:9092,b-39092,b-1:9092"
    zookeeper:
      server: "z-2:2181,z-3:2181,z-1:2181"

    topics:
      metadata_change_event_name: "MetadataChangeEvent_v4"
      failed_metadata_change_event_name: "FailedMetadataChangeEvent_v4"
      metadata_audit_event_name: "MetadataAuditEvent_v4"
      datahub_usage_event_name: "DataHubUsageEvent_v1"
      metadata_change_proposal_topic_name: "MetadataChangeProposal_v1"
      failed_metadata_change_proposal_topic_name: "FailedMetadataChangeProposal_v1"
      metadata_change_log_versioned_topic_name: "MetadataChangeLog_Versioned_v1"
      metadata_change_log_timeseries_topic_name: "MetadataChangeLog_Timeseries_v1"
      platform_event_topic_name: "PlatformEvent_v1"
      datahub_upgrade_history_topic_name: "DataHubUpgradeHistory_v1"
    ## For AWS MSK set this to a number larger than 1
    # partitions: 3
    # replicationFactor: 3

    schemaregistry:
      # Glue Implementation - `url` not applicable
      type: AWS_GLUE
      glue:
        region: us-west-2
        registry: datahub-poc

Appreciate any help to get this resolved. TIA

@orange-night-91387 might be able to speak to this!

Version details

datahub:
    version: v0.10.4

As you can see from the error, the property path is:

${kafka.schemaRegistry.awsGlue.region}

but in your values.yaml you have:

kafka.schemaregistry.glue.region

Thanks for checking @orange-night-91387 I am following the syntax listed here https://github.com/acryldata/datahub-helm/blob/master/charts/datahub/values.yaml#L494-L498

Ah okay I see what's happening, looks like the glue configuration got commented out for some reason. Will synch with teammate who made this change and see why. https://github.com/datahub-project/datahub/blob/master/metadata-service/configuration/src/main/resources/application.yml#L227

We'll be fixing this, I believe you can work around it with setting up an extraEnv for:

KAFKA_SCHEMAREGISTRY_AWSGLUE_REGION

which Spring should pick up and resolve to the dot notation using the system environment property placeholder configurer.