Hi, I'm trying to get data from PowerBI. I connect...
# troubleshoot
b
Hi, I'm trying to get data from PowerBI. I connected succesfully but ingestion fails. I see following warnings:
Copy code
Non relational data-source found = {'datasourceType': 'Extension', 'connectionDetails': {'path': '...', 'kind': 'Snowflake'}, 'datasourceId': '...', 'gatewayId': '...'}
This looks strange
Copy code
[2023-03-21 12:37:24,095] INFO     {datahub.ingestion.reporting.file_reporter:52} - Wrote UNKNOWN report successfully to <_io.TextIOWrapper name='/tmp/datahub/ingest/3865c265-8540-4f4c-be96-f59e1d2056af/ingestion_report.json' mode='w' encoding='UTF-8'>
and in the end:
Copy code
[2023-03-21 12:37:24,385] ERROR    {datahub.entrypoints:213} - Command failed: Failed to fetch reports from power-bi for
When I connected to the workspace without datasets with DirectQuery it finished succesfully
g
Could you please share • datahub version • Ingestion log file • And recipe
b
Copy code
v0.9.5

source:
    type: powerbi
    config:
        tenant_id: id
        workspace_id: id
        env: PROD
        client_id: id
        client_secret: id
        extract_ownership: false
        dataset_type_mapping:
            PostgreSql: postgres
            Oracle: oracle
@gray-shoe-75895 could you look at this one?
a
It looks like you’re using cli v0.9.5. Could you try upgrading to latest?
b
Hi, we have upgraded to v0.10.2 but still data from one of the workspaces is not fetched (the only difference is that ingestion finishes sucesfully and workspace is fetched). We have multiple datasets there, including ones with Direct Query and only workspace name is fetched. In case of other workspace containing one dataset (import mode) everything is fetched. Logfile for the workspace with DQ and composite models.
g
Hi @bored-mouse-25356 I can see 401 error in log
Could you please follow setup steps mentioned on https://datahubproject.io/docs/quick-ingestion-guides/powerbi/setup
while replying please tag me
b
@gentle-hamburger-31302 setup on tenant level is OK because I'm able to get full metadata from the other workspace, the only difference is Direct Query in this faulty one.
g
@bored-mouse-25356 Could you please share the debug level logs?
@bored-mouse-25356 Did you got a chance to generate debug level logs for the issue ?
b
g
Thanks
b
Hi @gentle-hamburger-31302, how it's going with this one?
g
Hi @bored-mouse-25356 We are preparing powerbi environment to reproduce this issue at our end. I will update you once setup is ready
Hi @bored-mouse-25356 Does Direct Query dataset source belongs to any of SQL, Oracle, Teradata, and SAP HANA ?
tag me while replying
b
@gentle-hamburger-31302 it's Snowflake
a
@bored-mouse-25356 I setup the direct query with snowflake and powerbi connector is ingesting data, I haven't face above issue
Could you please confirm the security group is added as
admin
in workspace.
b
@gentle-hamburger-31302 I confirm