Hey, this is the first extraction that I'm doing. ...
# ingestion
g
Hey, this is the first extraction that I'm doing. I have a simple recipe:
Copy code
source:
  type: mysql
  config:
    host_port: XXX
    database: XXX
    username: XXX
    password: XXX
    env: Production
    include_views: False

sink:
  type: "datahub-rest"
  config:
    server: "<http://localhost:8080>"
It runs fine and I get this as output:
Copy code
{'entities_profiled': 0,
 'failures': {},
 'filtered': [],
 'query_combiner': None,
 'soft_deleted_stale_entities': [],
 'tables_scanned': 215,
 'views_scanned': 0,
 'warnings': {'DB.AAA': ['unable to map type BIT(length=1) to metadata schema'],
              'DB.BBB': ['unable to map type BIT(length=1) to metadata schema'],
              'DB.CCC': ['unable to map type BIT(length=1) to metadata schema'],
              'DB.DDD': ['unable to map type BIT(length=1) to metadata schema']},
 'workunit_ids': [LIST OF TABLES HERE],
 'workunits_produced': 215}
Sink (datahub-rest) report:
{'downstream_end_time': None,
 'downstream_start_time': None,
 'downstream_total_latency_in_seconds': None,
 'failures': [],
 'records_written': 0,
 'warnings': []}
As you can see, it says 215 tables are scanned and there are 4 warnings but
records_written
is 0 🤔
nvm, I was running the command with
-n
flag and that was the reason
👍 1