Hi, I am trying to deploy DataHub through argoCD. ...
# all-things-deployment
l
Hi, I am trying to deploy DataHub through argoCD. We have Azure EventHub setup. Wondering how the configuration would look like in values.yaml file for kafka if we want to use Azure EventHub.: kafka: bootstrap: server: “prerequisites-kafka:9092” zookeeper: server: “prerequisites-zookeeper:2181" # This section defines the names for the kafka topics that DataHub depends on, at a global level. Do not override this config # at a sub-chart level. topics: metadata_change_event_name: “MetadataChangeEvent_v4” failed_metadata_change_event_name: “FailedMetadataChangeEvent_v4" metadata_audit_event_name: “MetadataAuditEvent_v4” datahub_usage_event_name: “DataHubUsageEvent_v1" metadata_change_proposal_topic_name: “MetadataChangeProposal_v1” failed_metadata_change_proposal_topic_name: “FailedMetadataChangeProposal_v1" metadata_change_log_versioned_topic_name: “MetadataChangeLog_Versioned_v1” metadata_change_log_timeseries_topic_name: “MetadataChangeLog_Timeseries_v1" platform_event_topic_name: “PlatformEvent_v1” datahub_upgrade_history_topic_name: “DataHubUpgradeHistory_v1" maxMessageBytes: “5242880” # 5MB producer: compressionType: none maxRequestSize: “5242880" # 5MB consumer: maxPartitionFetchBytes: “5242880” # 5MB stopContainerOnDeserializationError: true ## For AWS MSK set this to a number larger than 1 # partitions: 3 # replicationFactor: 3 schemaregistry: # GMS Implementation -
url
configured based on component context type: INTERNAL # Confluent Kafka Implementation # type: KAFKA # url: “http://prerequisites-cp-schema-registry:8081” # Glue Implementation -
url
not applicable # type: AWS_GLUE # glue: # region: us-east-1 # registry: datahub
b
You would have to consult Azure's documentation for guidance on how to configure. This seems relevant: https://learn.microsoft.com/en-us/azure/event-hubs/azure-event-hubs-kafka-overview#shared-access-signature-sas