Thread
#secoda-support
b
blue-ocean-91219
7 months ago
Our team would love to see lineage all the way down to our Power BI reports. Currently, the Power BI integration doesn't show queries / upstream tables that are being pulled in from Snowflake. Our team is already pulling this lineage information from the Power BI API (in a sort of hacky way). We'd love to see this either be integrated into the Power BI integration and/or allow posting/altering lineage info using the API.
e
elegant-house-93198
7 months ago
Hey @blue-ocean-91219 I’d love to hear how your team is pulling this lineage information from the Power BI API. We could apply that to our extractors to get the end-to-end lineage going for you.
When we made the PowerBI integration I couldn’t find any information related to the connections between datasets and the source tables from snowflake. If we have that information it’s very straightforward to add it to the Secoda product.
b
blue-ocean-91219
7 months ago
Hi @elegant-house-93198, so we're using the Power BI Admin API's Metadata Scanning feature. This does have to be enabled by the Power BI admin to start collecting metadata.
These scan results include a "tables" object inside of a dataset object, which includes table names and a "source" expression that provides the snowflake connection details, database, schema, and table name.
The "source" expression is the raw Power Query
e
elegant-house-93198
7 months ago
This is helpful context, I did see they recently released the scanner API and haven’t gotten the chance to explore it further. So it’s good that you’ve actually accomplished getting lineage information so that makes me optimistic we can do it as well.
View count: 1
Join thread in Slack