Hello, We’re facing an issue with our ingestion pi...
# ingestion
a
Hello, We’re facing an issue with our ingestion pipelines where manually added tags from the UI are getting overwritten. • Is this expected? • Is it possible to disable this behaviour and keep both the manually added tags and the ingested tags? Thanks, Stian
g
Hi @adamant-sunset-13770 Which source are you using? It is depend on source. For example transformer supports PATCH mechanism where this behaviour is not expected https://datahubproject.io/docs/metadata-ingestion/docs/transformer/intro please tag me while replying
a
Hi, @gentle-hamburger-31302 Thank you for responding! The source we are using is BigQuery
g
Hi @adamant-sunset-13770 I think BigQuery behaviour is overwrite one. One workaround is you can add a transformer (simple-add-dataset-globaltags ) in your recipe and configure it as per option "Add tags, however keep the tags available for the dataset on DataHub GMS", this transformer support
semantics: PATCH
@dazzling-judge-80093 Is it possible to preserve user added tag in BigQuery ingestion without above workaround.