Hello! I am trying to add a transformer to my inge...
# ingestion
m
Hello! I am trying to add a transformer to my ingestion recipe to get ownership and tags from Snowflake into Datahub. When I try it for tags like this: transformer: - type: simple_add_dataset_tags config: tag_urns: - "urnlitag:NeedsDocumentation" - "urnlitag:HeyImATag" I get this error message: 1 validation error for PipelineConfig transformer extra fields not permitted (type=value_error.extra) Hope someone is able to help:)
m
@most-cricket-43285 the config key for adding transformers is
transformers
not
transformer
. If you change that, things should start working! Docs are here: https://datahubproject.io/docs/metadata-ingestion/transformers
m
Aaah thank you, it works now! Haha what a silly mistake😅
🎉 1