Does datahub support ingesting kafka topic tags? Like Lenses describes here (We don't use Lenses)? https://lenses.io/blog/2021/04/apache-kafka-metadata-management/

Hey @prehistoric-dream-67257 you can add tags to ingested kafka topics in DataHub UI as shown here - https://datahubproject.io/docs/tags/#using-datahub-tags Is that what you are looking for ?

Almost - we actually set our tags in the terraform definition file for the topic, so we need a way to pull the data from the Kafka cluster / topic config, into datahub, automagically. I believe what you are suggesting, is adding the tags by hand in Datahub, which is not desirable. Hope that helps clarify, and that I understood you correctly.

Oh, got it. If not by hand, there is also another way - one can write a python script / ingestion source which reads terraform definition files for kafka topics and ingests respective topic-tags into DataHub. Here is a simple example of ingesting tag into DataHub using python script - https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/examples/library/dataset_set_tag.py

Brilliant, just what I was looking for. Thanks! You are a super 🌟 !!