Hey there Anyone knows if there’s a way to enable ...
# ingestion
r
Hey there Anyone knows if there’s a way to enable auto tagging of columns via ingestion transformers? I see tagging datasets is working, but I couldn’t figure out how to tag columns For example: any column mathing
.**email.**
should be tagged as
email
plus1 2
m
There's SchemaMetadata aspect in MCE, you can look into each field in that aspect.
s
You can look at writing a custom transformer where you make that change https://datahubproject.io/docs/metadata-ingestion/transformers/#writing-a-custom-transformer-from-scratch. If you would like to contribute it back to open-source please discuss in #contribute and team would be happy to help
l
@rapid-article-86196 echoing what Aseem said - my hunch is there are many people in the Community that would benefit from a transformer like this; if you’re interested in contributing something back, please keep us posted! I can make sure we are available to provide guidance/support as you go along 🙂