Hey all - wondering if anyone has any ideas about creating new tags when they are ingested as part of a dataset. When we ingest a dataset we are adding custom tags that don't yet exist in the

GlobalTags

aspect. The tag itself isn't ingested(not in the elastic tag index so we cant search!) but does properly appear on the dataset and in the list of 'filter checkboxes' when viewing data sets. Is there anyway to have the tag also created outside of ingesting the tag separately before ingesting the data set? Not sure if it makes sense to try solve it in one place (within dathaub itself) versus in each of our ingestion plugins

I suppose we could possibly emit the tag during a transformer stage to gms? I also have the same problem actually, but I manually added the tags in UI because there isn't many of these cases for me.

Hi. As @better-orange-49102 mentioned, we don’t validate the urns inputted as fields in the MCE i.e. we do not check whether the urn exists. This means that unless you ingest the tags themselves, we won’t ingest them. We are working on a solution for this, where we provide you with transformers for adding tags, where these tags are created if not exists. We will get back to you sson.

Awesome - in the mean time I will create them directly prior! Let me know if I can help at all with the transformer solution