gray-wall-52477
01/06/2022, 11:59 PMsource:
type: mysql
config:
host_port: XXX
database: XXX
username: XXX
password: XXX
env: Production
include_views: False
sink:
type: "datahub-rest"
config:
server: "<http://localhost:8080>"
It runs fine and I get this as output:
{'entities_profiled': 0,
'failures': {},
'filtered': [],
'query_combiner': None,
'soft_deleted_stale_entities': [],
'tables_scanned': 215,
'views_scanned': 0,
'warnings': {'DB.AAA': ['unable to map type BIT(length=1) to metadata schema'],
'DB.BBB': ['unable to map type BIT(length=1) to metadata schema'],
'DB.CCC': ['unable to map type BIT(length=1) to metadata schema'],
'DB.DDD': ['unable to map type BIT(length=1) to metadata schema']},
'workunit_ids': [LIST OF TABLES HERE],
'workunits_produced': 215}
Sink (datahub-rest) report:
{'downstream_end_time': None,
'downstream_start_time': None,
'downstream_total_latency_in_seconds': None,
'failures': [],
'records_written': 0,
'warnings': []}
As you can see, it says 215 tables are scanned and there are 4 warnings but records_written is 0 🤔gray-wall-52477
01/07/2022, 12:08 AM-n flag and that was the reason