I am trying to use a transformer when ingesting da...
# ingestion
c
I am trying to use a transformer when ingesting data from mssql. I am getting an error with the following details
Copy code
source:
  type: mssql
  config:
    host_port: host:1433
    username: <user>
    password: <password>
    database: <db>
    table_pattern:
      deny:
        - "^.*\\.sys_.*" # deny all tables that start with sys_
        - "^.*\\.cdc.*"
transformer:
  type: "simple_add_dataset_tags"
  config:
    tag_urns:
      - "urn:li:tag:NeedsDocumentation"
sink:
  type: "datahub-rest"
  config:
    server: "http://<IP>:8080"

Error: 

 datahub ingest -c ./mssql_poc.yml
1 validation error for PipelineConfig
transformers
  value is not a valid list (type=type_error.list)
g
transformer itself should be a list of items e.g.
Copy code
source:
  type: mssql
  config:
    host_port: host:1433
    username: <user>
    password: <password>
    database: <db>
    table_pattern:
      deny:
        - "^.*\\.sys_.*" # deny all tables that start with sys_
        - "^.*\\.cdc.*"
transformer:
  - type: "simple_add_dataset_tags"
    config:
      tag_urns:
        - "urn:li:tag:NeedsDocumentation"
sink:
  type: "datahub-rest"
  config:
    server: "http://<IP>:8080"
c
Thank you @gray-shoe-75895 Was able to get it working.
🙌 1