narrow-queen-90189
02/27/2023, 10:58 PM~~~~ Ingestion Logs ~~~~
Obtaining venv creation lock...
Acquired venv creation lock
venv setup time = 0
This version of datahub supports report-to functionality
datahub ingest run -c /tmp/datahub/ingest/c3d726e3-088f-4574-af3c-89d4831fb7f9/recipe.yml --report-to /tmp/datahub/ingest/c3d726e3-088f-4574-af3c-89d4831fb7f9/ingestion_report.json
[2023-02-27 22:25:55,940] INFO {datahub.cli.ingest_cli:165} - DataHub CLI version: 0.10.0
[2023-02-27 22:25:55,965] INFO {datahub.ingestion.run.pipeline:179} - Sink configured successfully. DataHubRestEmitter: configured to talk to <http://datahub-gms:8080>
/tmp/datahub/ingest/venv-powerbi-0.10.0/lib/python3.10/site-packages/datahub/ingestion/source/powerbi/powerbi.py:867: ConfigurationWarning: env is deprecated and will be removed in a future release. Please use platform_instance instead.
config = PowerBiDashboardSourceConfig.parse_obj(config_dict)
[2023-02-27 22:25:56,235] INFO {datahub.ingestion.source.powerbi.proxy:231} - Trying to connect to <https://login.microsoftonline.com/{tenant-id}>
[2023-02-27 22:25:56,235] INFO {datahub.ingestion.source.powerbi.proxy:349} - Generating PowerBi access token
[2023-02-27 22:25:56,375] INFO {datahub.ingestion.source.powerbi.proxy:363} - Generated PowerBi access token
[2023-02-27 22:25:56,375] INFO {datahub.ingestion.source.powerbi.proxy:233} - Able to connect to <https://login.microsoftonline.com/{tenant-id}>
[2023-02-27 22:25:56,587] INFO {datahub.ingestion.source.powerbi.proxy:231} - Trying to connect to <https://login.microsoftonline.com/{tenant-id}>
[2023-02-27 22:25:56,588] INFO {datahub.ingestion.source.powerbi.proxy:349} - Generating PowerBi access token
[2023-02-27 22:25:56,679] INFO {datahub.ingestion.source.powerbi.proxy:363} - Generated PowerBi access token
[2023-02-27 22:25:56,679] INFO {datahub.ingestion.source.powerbi.proxy:233} - Able to connect to <https://login.microsoftonline.com/{tenant-id}>
[2023-02-27 22:25:56,679] INFO {datahub.ingestion.run.pipeline:196} - Source configured successfully.
[2023-02-27 22:25:56,681] INFO {datahub.cli.ingest_cli:120} - Starting metadata ingestion
[2023-02-27 22:25:56,682] INFO {datahub.ingestion.source.powerbi.powerbi:892} - PowerBi plugin execution is started
[2023-02-27 22:25:56,682] INFO {datahub.ingestion.source.powerbi.proxy:757} - Request to get groups endpoint URL=<https://api.powerbi.com/v1.0/myorg/groups>
[2023-02-27 22:25:56,852] INFO {datahub.ingestion.reporting.file_reporter:52} - Wrote SUCCESS report successfully to <_io.TextIOWrapper name='/tmp/datahub/ingest/c3d726e3-088f-4574-af3c-89d4831fb7f9/ingestion_report.json' mode='w' encoding='UTF-8'>
[2023-02-27 22:25:56,852] INFO {datahub.cli.ingest_cli:133} - Finished metadata ingestion
Cli report:
{'cli_version': '0.10.0',
'cli_entry_location': '/tmp/datahub/ingest/venv-powerbi-0.10.0/lib/python3.10/site-packages/datahub/__init__.py',
'py_version': '3.10.9 (main, Jan 23 2023, 22:32:48) [GCC 10.2.1 20210110]',
'py_exec_path': '/tmp/datahub/ingest/venv-powerbi-0.10.0/bin/python3',
'os_details': 'Linux-5.15.0-1026-aws-x86_64-with-glibc2.31',
'mem_info': '70.89 MB'}
Source (powerbi) report:
{'events_produced': 0,
'events_produced_per_sec': 0,
'entities': {},
'aspects': {},
'warnings': {},
'failures': {},
'dashboards_scanned': 0,
'charts_scanned': 0,
'filtered_dashboards': [],
'filtered_charts': [],
'start_time': '2023-02-27 22:25:56.071050 (now)',
'running_time': '0.94 seconds'}
Sink (datahub-rest) report:
{'total_records_written': 0,
'records_written_per_second': 0,
'warnings': [],
'failures': [],
'start_time': '2023-02-27 22:25:55.962587 (1.04 seconds ago)',
'current_time': '2023-02-27 22:25:57.006657 (now)',
'total_duration_in_seconds': 1.04,
'gms_version': 'v0.10.0',
'pending_requests': 0}
Pipeline finished successfully; produced 0 events in 0.94 seconds.