Hi, I am trying to deploy DataHub through argoCD. We have Azure EventHub setup. Wondering how the configuration would look like in values.yaml file for kafka if we want to use Azure EventHub.:
kafka:
bootstrap:
server: “prerequisites-kafka:9092”
zookeeper:
server: “prerequisites-zookeeper:2181"
# This section defines the names for the kafka topics that DataHub depends on, at a global level. Do not override this config
# at a sub-chart level.
topics:
metadata_change_event_name: “MetadataChangeEvent_v4”
failed_metadata_change_event_name: “FailedMetadataChangeEvent_v4"
metadata_audit_event_name: “MetadataAuditEvent_v4”
datahub_usage_event_name: “DataHubUsageEvent_v1"
metadata_change_proposal_topic_name: “MetadataChangeProposal_v1”
failed_metadata_change_proposal_topic_name: “FailedMetadataChangeProposal_v1"
metadata_change_log_versioned_topic_name: “MetadataChangeLog_Versioned_v1”
metadata_change_log_timeseries_topic_name: “MetadataChangeLog_Timeseries_v1"
platform_event_topic_name: “PlatformEvent_v1”
datahub_upgrade_history_topic_name: “DataHubUpgradeHistory_v1"
maxMessageBytes: “5242880” # 5MB
producer:
compressionType: none
maxRequestSize: “5242880" # 5MB
consumer:
maxPartitionFetchBytes: “5242880” # 5MB
stopContainerOnDeserializationError: true
## For AWS MSK set this to a number larger than 1
# partitions: 3
# replicationFactor: 3
schemaregistry:
# GMS Implementation -
url
configured based on component context
type: INTERNAL
# Confluent Kafka Implementation
# type: KAFKA
# url: “
http://prerequisites-cp-schema-registry:8081”
# Glue Implementation -
url
not applicable
# type: AWS_GLUE
# glue:
# region: us-east-1
# registry: datahub