careful-insurance-60247
07/22/2021, 2:18 PMsource:
type: mssql
config:
host_port: host:1433
username: <user>
password: <password>
database: <db>
table_pattern:
deny:
- "^.*\\.sys_.*" # deny all tables that start with sys_
- "^.*\\.cdc.*"
transformer:
type: "simple_add_dataset_tags"
config:
tag_urns:
- "urn:li:tag:NeedsDocumentation"
sink:
type: "datahub-rest"
config:
server: "http://<IP>:8080"
Error:
datahub ingest -c ./mssql_poc.yml
1 validation error for PipelineConfig
transformers
value is not a valid list (type=type_error.list)gray-shoe-75895
07/22/2021, 5:48 PMsource:
type: mssql
config:
host_port: host:1433
username: <user>
password: <password>
database: <db>
table_pattern:
deny:
- "^.*\\.sys_.*" # deny all tables that start with sys_
- "^.*\\.cdc.*"
transformer:
- type: "simple_add_dataset_tags"
config:
tag_urns:
- "urn:li:tag:NeedsDocumentation"
sink:
type: "datahub-rest"
config:
server: "http://<IP>:8080"careful-insurance-60247
07/22/2021, 5:58 PM