Hello, i tried to use <reporting systems> , in the...
# ingestion
l
Hello, i tried to use reporting systems , in the end of ingesting i got logs
Copy code
>datahub --debug ingest -c ./mssql.yml
[2022-07-13 17:23:17,777] DEBUG    {datahub.telemetry.telemetry:201} - Sending init Telemetry
[2022-07-13 17:23:18,130] DEBUG    {datahub.telemetry.telemetry:234} - Sending Telemetry
[2022-07-13 17:23:18,302] INFO     {datahub.cli.ingest_cli:99} - DataHub CLI version: 0.8.40.3rc2
......

[2022-07-13 17:24:16,697] INFO     {datahub.ingestion.reporting.datahub_ingestion_reporting_provider:143} - Committing ingestion run summary for pipeline:'pipeline_name',instance:'mssql_localhost:1433_master', j
ob:'common_ingest_from_sql_source'
[2022-07-13 17:24:16,698] DEBUG    {datahub.emitter.rest_emitter:224} - Attempting to emit to DataHub GMS; using curl equivalent to:
curl -X POST -H 'User-Agent: python-requests/2.28.1' -H 'Accept-Encoding: gzip, deflate' -H 'Accept: */*' -H 'Connection: keep-alive' -H 'X-RestLi-Protocol-Version: 2.0.0' -H 'Content-Type: application/json' --data '{"pro
posal": {"entityType": "dataJob", "entityUrn": "urn:li:dataJob:(urn:li:dataFlow:(datahub,pipeline_name_mssql_localhost:1433_master,prod),common_ingest_from_sql_source)", "changeType": "UPSERT", "aspectName": "datahubIngestionRunSummary", "aspect": {"value": "< report data>"}}

[2022-07-13 17:24:16,759] INFO     {datahub.ingestion.reporting.datahub_ingestion_reporting_provider:169} - Committed ingestion run summary for pipeline:'pipeline_name',instance:'mssql_localhost:1433_master', jo
b:'common_ingest_from_sql_source'
[2022-07-13 17:24:16,760] INFO     {datahub.ingestion.run.pipeline:296} - Successfully committed changes for DatahubIngestionReportingProvider.
[2022-07-13 17:24:16,760] INFO     {datahub.cli.ingest_cli:133} - Finished metadata pipeline
[2022-07-13 17:24:16,760] DEBUG    {datahub.telemetry.telemetry:234} - Sending Telemetry

Source (mssql) report:
{'workunits_produced': 86,
 'workunit_ids': [<workunit ids here>],

 'warnings': {'database.schema.view': ['unable to map type BIT() to metadata schema']},
 'failures': {},
 'cli_version': '0.8.40.3rc2',
 'cli_entry_location': '\\lib\\site-packages\\acryl_datahub-0.8.40.3rc2-py3.8.egg\\datahub\\__init__.py',
 'py_version': '3.8.0 (tags/v3.8.0:fa919fd, Oct 14 2019, 19:37:50) [MSC v.1916 64 bit (AMD64)]',
 'py_exec_path': 'Scripts\\python.exe',
 'os_details': 'Windows-10-10.0.19041-SP0',
 'tables_scanned': 5,
 'views_scanned': 1,
 'entities_profiled': 0,
 'filtered': [],
 'soft_deleted_stale_entities': [],
 'query_combiner': None}
Sink (datahub-rest) report:
{'records_written': 86,
 'warnings': [],
 'failures': [],
 'downstream_start_time': datetime.datetime(2022, 7, 13, 17, 23, 30, 127613),
 'downstream_end_time': datetime.datetime(2022, 7, 13, 17, 24, 15, 739817),
 'downstream_total_latency_in_seconds': 45.612204,
 'gms_version': 'v0.8.40'}

Pipeline finished with 1 warnings in source producing 86 workunits
[2022-07-13 17:24:18,093] DEBUG    {datahub.telemetry.telemetry:234} - Sending Telemetry
Where can i look report info in datahub?
used standard mssql yml configuration with adding next params:
Copy code
pipeline_name: "pipeline_test"
reporting:
  - type: "datahub"