Hi everyone,
I see that it's possible to <configur...
# all-things-deploymentb
broad-battery-31188
07/05/2023, 12:30 PMHi everyone,
I see that it's possible to configure consumer group ids for datahub-mce-consumer and datahub-mae-consumer. how can it be done for the following consumer groups?
1. generic-platform-event-job-client
2. datahub-usage-event-consumer-job-client
✅ 1
broad-battery-31188
07/05/2023, 1:06 PMlooks like someone else is also experiencing this issue.
https://github.com/acryldata/datahub-helm/issues/319
broad-battery-31188
07/05/2023, 4:24 PMFollowing env vars work.
• METADATA_CHANGE_EVENT_KAFKA_CONSUMER_GROUP_ID
• METADATA_CHANGE_LOG_KAFKA_CONSUMER_GROUP_ID
• METADATA_CHANGE_PROPOSAL_KAFKA_CONSUMER_GROUP_ID
• PLATFORM_EVENT_KAFKA_CONSUMER_GROUP_ID
• DATAHUB_USAGE_EVENT_KAFKA_CONSUMER_GROUP_ID
• DATAHUB_UPGRADE_HISTORY_KAFKA_CONSUMER_GROUP_ID
r
ripe-agency-8696
10/04/2023, 8:24 PM@broad-battery-31188 how are these environment variables linked to the appropriate consumer groups
1. mce-consumer-job-client
2. generic-mce-consumer-job-client
3. generic-mae-consumer-job-client
4. datahub-usage-event-consumer-job-client
5. generic-platform-event-job-client
6. datahub-duhe-consumer-job-client-gms
Can you provide a 1 to 1 mapping for these default consumer group ids with their corresponding environment variables?
ripe-agency-8696
10/04/2023, 8:27 PMnever mind figured out the mapping
Copy code
DATAHUB_USAGE_EVENT_KAFKA_CONSUMER_GROUP_ID -> datahub-usage-event-consumer-job-client
METADATA_CHANGE_EVENT_KAFKA_CONSUMER_GROUP_ID -> mce-consumer-job-client
METADATA_CHANGE_LOG_KAFKA_CONSUMER_GROUP_ID -> generic-mae-consumer-job-client
METADATA_CHANGE_PROPOSAL_KAFKA_CONSUMER_GROUP_ID -> generic-mce-consumer-job-client
PLATFORM_EVENT_KAFKA_CONSUMER_GROUP_ID -> generic-platform-event-job-client
DATAHUB_UPGRADE_HISTORY_KAFKA_CONSUMER_GROUP_ID -> datahub-duhe-consumer-job-client-gmsplus1 1