Hello! We’re using Tableau ingestion and faced som...
# ingestion
m
Hello! We’re using Tableau ingestion and faced some inconveniences • After ingestion, renaming anything in Tableau lead to duplicates. For example, renaming “Chart 1” to “Chart 1 (test)” will end up in two charts in datahub, named “Chart 1” and “Chart 1 (test)“, while the expected behaviour is to have one chart named “Chart 1 (test)“, same as in Tableau • Renaming datasources end up in the same problem as above • If you delete workbook in Tableau, it won’t disappear in DataHub automatically Is there a way to fix this? Renaming problem is most concerning, since a lot of people contribute in our Tableau and it may end up in a lot of duplicates with different names.
It seems that the main issue is that once DataHub imported something, it will remain unchanged, and that DataHub uses names as “id” of an object Is it really how it works? Are there some configuration options that can change that?
m
Essentially that is how it works. Some sources have "stateful ingestion" which can remove entities that no longer exist. Unfortunately tableau source doesnt have stateful ingestion yet
m
Understood, thank you How can one understand whether source have stateful ingestion? For example we also have ingestion with ClickHouse, Aqueduct and database on Miscrosoft SQL Server
And is having “stateful ingestion” depends on developers of the platform (e.g. Tableau developers) or your own available resources to improve feature?
m
https://datahubproject.io/docs/generated/ingestion/sources/clickhouse Looks like clickhouse has stateful ingestion. You can see the feature "deleted entities detection"
Sql server also has it
m
Thank you very much! Is it worth to expect Tableau ingestion to be stateful as well one day?
m
I think it makes sense to have stateful ingestion for tableau as well.
m
Sorry, I don’t quite understand. Is it possible to do on DataHub side and hence worth posting it in Requested Features, or is it something that cannot be done yet because of Tableau own limitations?
m
It should be a feature request.
m
Got it, thank you very much again ❤️
m
You're welcome