https://datahubproject.io logo
Join SlackCommunities
Powered by
Hi all, I am trying to get the lineage of one of m...
# integrate-tableau-datahub
f
Hi all, I am trying to get the lineage of one of my workbooks but it seems that the Tableau lineage does is not linked to the BigQuery table even though it uses one as a source. What I expect is : BigQuery table -> Published data source -> Embedded Data Source -> Charts But I get : Published data source -> Embedded Data Source -> Charts
h
Hi @faint-advantage-18690 are you using custom SQLs to connect to bigquery?
f
Hi @hundreds-photographer-13496 we tried two methods , using a custom SQL and the souce directly but none of them work
h
That's definitely not as expected. Can you run this publishedDatasourcesConnection query on tableau graphiql interface by replacing 
idWithin
filter in mentioned query to use id of your published datasource ? (you can get datasource id (uuid part) from datasource's urn.) Ideally you should see 
upstreamTables
pointing to bigquery tables in graphql response.
f
The query returns null so no upstream pointing to a BQ table
h
does query return other details like name of published datasource, downstream sheets ?
f
Yes we have the name of the published datasource and its downstream sheets
In our BQ logs we see the tableau user query the table successfully
h
Unfortunately if tableau metadata api 
publishedDatasourcesConnection
query itself does not return 
upstreamTables
, datahub tableau source will not be able to extract the upstream lineage currently. We have observed in the past that tableau fails to extract upstream lineage in some cases of custom SQLs. Can you retry the same tableau metadata query without using Custom SQL and directly using the bigquery table ?
f
So we removed the custom SQL but we still have null values in the upstreamTables
{
"data": {
"publishedDatasourcesConnection": {
"nodes": [
{
"__typename": "PublishedDatasource",
"id": "75ed993d-5aa5-f33c-2849-06b1c9d37a4d",
"name": "MySource",
"hasExtracts": true,
"extractLastRefreshTime": "2022-07-13T08:08:50Z",
"extractLastIncrementalUpdateTime": null,
"extractLastUpdateTime": "2022-07-13T08:08:50Z",
"downstreamSheets": [
{
"id": "13527a0d-5952-a141-0898-0ae8d5bedfdb",
"name": "Last Update"
},
{
"id": "3ef6eb6a-f14a-840b-464b-86f9557bb5aa",
"name": "Test2"
},
{
"id": "4445f9b5-0478-af47-a8b4-e8a2f308de41",
"name": "Last Update"
},
{
"id": "9ae5293e-05b4-7dd9-c221-916406560db3",
"name": "Test3"
},
{
"id": "c6b019d9-5cbb-8657-3a19-02693afde386",
"name": "Test4"
},
{
"id": "f5531582-3255-cf24-e485-9a9bd2f761d8",
"name": "Last Update"
}
],
"upstreamTables": [
{
"name": null,
"schema": null,
"fullName": null,
"connectionType": null,
"description": null,
"contact": null
}
],
h
oh, this seems to be a permissions issue. Can you try re-running with with site admin creator privilege as suggested here ?https://datahubspace.slack.com/archives/C02GBGG90CU/p1651103727059569?thread_ts=1651054096.939339&cid=C02GBGG90CU For more context - Here is how tableau decides permissions on metadata - https://help.tableau.com/current/online/en-us/dm_perms_assets.htm#permissions-on-metadata
thank you 1
f
We made a request to get admin privilege for our accounts. Thank you very much for your help @hundreds-photographer-13496 !
h
Hi @faint-advantage-18690 Could you get lineage to work ?
f
Hello @hundreds-photographer-13496 Yes it worked 🙂 the "upstream_tables" is not null anymore, and datahub is able to make the link between BQ and the source in Tableau! Thank you so much for your help!
h
Great !! Just to confirm - you had to upgrade to admin privilege and it started working with no more changes ?
f
Yes!
5 Views
Open in Slack
PreviousNext
Powered by