acoustic-printer-83045
04/26/2021, 4:17 AM➜ datahub git:(enhance-dbt-ingestion) ✗ ./docker/ingestion/ingestion.sh
Pulling ingestion ... done
WARNING: Found orphan containers (zookeeper, schema-registry, datahub-gms, broker, kafka-setup, neo4j, kibana, schema-registry-ui, elasticsearch, elasticsearch-setup, datahub-mce-consumer, kafka-rest-proxy, datahub-mae-consumer, mysql, datahub-frontend-react, kafka-topics-ui) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.
Creating ingestion ... done
Attaching to ingestion
ingestion | [2021-04-26 04:15:24,111] INFO {datahub.entrypoints:68} - Using config: {'source': {'type': 'file', 'config': {'filename': '/bootstrap_mce.json'}}, 'sink': {'type': 'datahub-rest', 'config': {'server': '<http://datahub-gms:8080>'}}}
ingestion | [2021-04-26 04:15:24,158] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:0
ingestion | [2021-04-26 04:15:24,178] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:1
ingestion | [2021-04-26 04:15:24,268] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:2
ingestion | [2021-04-26 04:15:24,329] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:3
ingestion | [2021-04-26 04:15:24,389] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:4
ingestion | [2021-04-26 04:15:24,433] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:5
ingestion | [2021-04-26 04:15:24,475] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:6
ingestion | [2021-04-26 04:15:24,516] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:7
ingestion | [2021-04-26 04:15:24,547] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:8
ingestion | [2021-04-26 04:15:24,587] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:9
ingestion | [2021-04-26 04:15:24,619] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:10
ingestion | [2021-04-26 04:15:24,657] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:11
ingestion | [2021-04-26 04:15:24,692] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:12
ingestion | [2021-04-26 04:15:24,710] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:13
ingestion | [2021-04-26 04:15:24,737] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:14
ingestion | [2021-04-26 04:15:24,851] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:15
ingestion | [2021-04-26 04:15:24,878] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:16
ingestion | [2021-04-26 04:15:24,899] INFO {datahub.ingestion.run.pipeline:44} - sink wrote workunit file:///bootstrap_mce.json:17
ingestion |
ingestion | Source report:
ingestion | {'failures': {},
ingestion | 'warnings': {},
ingestion | 'workunit_ids': ['file:///bootstrap_mce.json:0',
ingestion | 'file:///bootstrap_mce.json:1',
ingestion | 'file:///bootstrap_mce.json:2',
ingestion | 'file:///bootstrap_mce.json:3',
ingestion | 'file:///bootstrap_mce.json:4',
ingestion | 'file:///bootstrap_mce.json:5',
ingestion | 'file:///bootstrap_mce.json:6',
ingestion | 'file:///bootstrap_mce.json:7',
ingestion | 'file:///bootstrap_mce.json:8',
ingestion | 'file:///bootstrap_mce.json:9',
ingestion | 'file:///bootstrap_mce.json:10',
ingestion | 'file:///bootstrap_mce.json:11',
ingestion | 'file:///bootstrap_mce.json:12',
ingestion | 'file:///bootstrap_mce.json:13',
ingestion | 'file:///bootstrap_mce.json:14',
ingestion | 'file:///bootstrap_mce.json:15',
ingestion | 'file:///bootstrap_mce.json:16',
ingestion | 'file:///bootstrap_mce.json:17'],
ingestion | 'workunits_produced': 18}
ingestion | Sink report:
ingestion | {'failures': [], 'records_written': 18, 'warnings': []}
ingestion |
ingestion | Pipeline finished successfully
ingestion exited with code 0
➜ datahub git:(enhance-dbt-ingestion) ✗