lively-ice-56461
07/13/2022, 2:34 PM>datahub --debug ingest -c ./mssql.yml
[2022-07-13 17:23:17,777] DEBUG {datahub.telemetry.telemetry:201} - Sending init Telemetry
[2022-07-13 17:23:18,130] DEBUG {datahub.telemetry.telemetry:234} - Sending Telemetry
[2022-07-13 17:23:18,302] INFO {datahub.cli.ingest_cli:99} - DataHub CLI version: 0.8.40.3rc2
......
[2022-07-13 17:24:16,697] INFO {datahub.ingestion.reporting.datahub_ingestion_reporting_provider:143} - Committing ingestion run summary for pipeline:'pipeline_name',instance:'mssql_localhost:1433_master', j
ob:'common_ingest_from_sql_source'
[2022-07-13 17:24:16,698] DEBUG {datahub.emitter.rest_emitter:224} - Attempting to emit to DataHub GMS; using curl equivalent to:
curl -X POST -H 'User-Agent: python-requests/2.28.1' -H 'Accept-Encoding: gzip, deflate' -H 'Accept: */*' -H 'Connection: keep-alive' -H 'X-RestLi-Protocol-Version: 2.0.0' -H 'Content-Type: application/json' --data '{"pro
posal": {"entityType": "dataJob", "entityUrn": "urn:li:dataJob:(urn:li:dataFlow:(datahub,pipeline_name_mssql_localhost:1433_master,prod),common_ingest_from_sql_source)", "changeType": "UPSERT", "aspectName": "datahubIngestionRunSummary", "aspect": {"value": "< report data>"}}
[2022-07-13 17:24:16,759] INFO {datahub.ingestion.reporting.datahub_ingestion_reporting_provider:169} - Committed ingestion run summary for pipeline:'pipeline_name',instance:'mssql_localhost:1433_master', jo
b:'common_ingest_from_sql_source'
[2022-07-13 17:24:16,760] INFO {datahub.ingestion.run.pipeline:296} - Successfully committed changes for DatahubIngestionReportingProvider.
[2022-07-13 17:24:16,760] INFO {datahub.cli.ingest_cli:133} - Finished metadata pipeline
[2022-07-13 17:24:16,760] DEBUG {datahub.telemetry.telemetry:234} - Sending Telemetry
Source (mssql) report:
{'workunits_produced': 86,
'workunit_ids': [<workunit ids here>],
'warnings': {'database.schema.view': ['unable to map type BIT() to metadata schema']},
'failures': {},
'cli_version': '0.8.40.3rc2',
'cli_entry_location': '\\lib\\site-packages\\acryl_datahub-0.8.40.3rc2-py3.8.egg\\datahub\\__init__.py',
'py_version': '3.8.0 (tags/v3.8.0:fa919fd, Oct 14 2019, 19:37:50) [MSC v.1916 64 bit (AMD64)]',
'py_exec_path': 'Scripts\\python.exe',
'os_details': 'Windows-10-10.0.19041-SP0',
'tables_scanned': 5,
'views_scanned': 1,
'entities_profiled': 0,
'filtered': [],
'soft_deleted_stale_entities': [],
'query_combiner': None}
Sink (datahub-rest) report:
{'records_written': 86,
'warnings': [],
'failures': [],
'downstream_start_time': datetime.datetime(2022, 7, 13, 17, 23, 30, 127613),
'downstream_end_time': datetime.datetime(2022, 7, 13, 17, 24, 15, 739817),
'downstream_total_latency_in_seconds': 45.612204,
'gms_version': 'v0.8.40'}
Pipeline finished with 1 warnings in source producing 86 workunits
[2022-07-13 17:24:18,093] DEBUG {datahub.telemetry.telemetry:234} - Sending Telemetry
Where can i look report info in datahub?lively-ice-56461
07/13/2022, 2:34 PMpipeline_name: "pipeline_test"
reporting:
- type: "datahub"