Hello, I’ve encountered the following issues while ingesting from Tableau, I am interested did anyone encounter similar issues: • Scoping by project name used by different projects doesn’t ingest all projects with that name. Example: There is a top level project

Coconut

and nested project

SomeTopLevelProject/Coconut

. When scoping needed projects in the recipe YAML, ie.

projects: ["Coconut"]

, ingestor doesn’t return workbooks from the top level project, only for the nested project. • Ingestor returns only few workbooks within a project without returning an error. From a project with 20 workbooks I got 3 workbook tops. I am not sure is this expected behaviour/imposed limit that should be tweaked from the Tableau side?

@brief-cricket-98290 it was suggested to set

project: null

to get all the projects. I'm trying this options out, it definitely gives more workbooks but i think there are still missing ones. You can try it out and see if it works. https://datahubspace.slack.com/archives/C02GBGG90CU/p1646640765142909?thread_ts=1644506882.510459&cid=C02GBGG90CU

Thanks @modern-artist-55754 I’ll try it out!

Hey @brief-cricket-98290 if you are facing an issue of tableau returning only few workbooks from project although more are present, its likely tableau metadata api returned NODE_LIMIT_EXCEEDED message. You would see this warning in ingestion logs as well. If that's the case, you can tune workbooks_page_size config to lesser value, say 3 or less and it should fix that case.

Thank you @hundreds-photographer-13496, I maybe missed that warning, will try tweaking that parameter!

We have same one stuff waiting for patch with setting of project filter by hierarchial path

and it would be nice if the browse path for Workbooks can reflect the actual hierarchy of the projects

+1

@brief-cricket-98290 I quickly tried to reproduce point 1 above and for me workbooks from both top level SubProject1 and nested project SubProject1 were ingested. Project Hierarchy: • Samples ◦ SubProject1 • SubProject1 config: projects: ["SubProject1"]

@hundreds-photographer-13496 i think the workbooks in Samples won’t be ingested, that’s probably what @brief-cricket-98290 means

True! Alongside mentioned issues, when tweaking with

project: null

and

workbooks_page_size

value, ingestor always breaks at some point and always on the same project, I’ll try to get to the bottom of that. If it is of any help, I’ll share the log file here

Oh! This was fixed in https://github.com/datahub-project/datahub/pull/4445. So it would not occur if you use release 0.8.32 or later.

Thanks for pointing it out! Altough I use 0.8.32 release, I see now that for some reason

acryl-datahub

is still on 0.8.28.1, it is maybe the culprit. Edit: unfortunately, even after updating it, the ingestor still breaks, just with a different error, will take a look 😞

oh. btw which tableau version are you using. I am a bit surprised to see workbook name as well as project name as None. wondering whether this is because of version or rather permissions.