Hello everyone, After testing happily Datahub locally, we wanted to do small PoC with stable deployment on k8s. Everything is working fine, except the parameters to connect to kafka: I need to be able to configure kafka consumer names and kafka topic names in order to fit to our internal conventions (or at least, be able to add a prefix for both, but full configuration would be better) While it seems possible to configure the consumer group (ie: https://github.com/linkedin/datahub/pull/1745/files ), which would solve one of my problems, it seems that the topics name are hardcoded (ie: https://github.com/linkedin/datahub/blob/master/metadata-events/mxe-registration/src/main/java/com/linkedin/mxe/Topics.java ), which would mean I would need to rebuild the docker image. Am I missing something obvious, or what would be the best way to achieve that? Thanks a lot for your time!.

Thank you for the interest in DataHub. You're correct that the Kafka topics are currently hard-coded. Please create an issue on GitHub so we can track the request if it's critical to your use case.

Thanks for the fast answer, really appreciated! This is what I feared but I wanted to be sure. https://github.com/linkedin/datahub/issues/1840 created. Not critical at all. I guess as I can find some work around if it is only in PoC 🙂

👍 we'll try to prioritize that. It does involve a few moving pieces so might take a bit to get it right. Also which company are you with if you don't mind sharing?

Thanks a lot! I am working for Flixbus.

Cool. We have others from transportation-related industry as well. Welcome to the community!

On the PoC section, I do not mind at all, feel free 🙂 FYI, we are now building our own version from yours to fix the topic convention issue. Works great as work around until we go out of PoC (where better solution will be required at some point of course).

Cool thanks.