Hey, We currently have an issue that we are overw...
# ingestion
c
Hey, We currently have an issue that we are overwriting manually (UI) added tags with our ingestion pipeline. Is it correct that there is still no no editable tags property? (source: thread) And if so, is this on the roadmap?
l
@green-football-43791 ^
g
Hey @calm-sunset-28996 - there is no editable tags aspect at the dataset level. I would recommend creating your own custom tags transformer that first fetches the existing tags for the dataset from GMS and then adds the tags youd like to add from your ingestion source and writes it back: https://datahubproject.io/docs/metadata-ingestion/transformers/#add-your-own-custom-transformer
c
Yeah we where thinking about that, but the problem is that this is not super scalable, as we would need to add this to every ingestion source which adds tags and we would need to tell the data producers to also add this to their pipelines. So in general this creates quite some noise, while to me at least it seems that an editable tag aspect, with the same behaviour as the other editable aspects, would be a cool feature to have. Then we can just use it out of the box.
g
For sure. Another option we now have is the
addTag
and
removeTag
graphql mutations- which is what I had speculated on back in that old thread you had pinged on 🙂 So you have the option to use those as well- they take an entity & a tag and handle the read-modify-write logic for you.
In some ways, that API is more useful than an editable tags aspect because it will still work in the case there are several writers.