Hi!
I’m new to datahub, trying some ingestion befo...
# ingestionc
curved-daybreak-29035
09/10/2021, 10:35 AMHi!
I’m new to datahub, trying some ingestion before implementing it for our company.
How to manage schemas and tables that are deprecated or changed in names?
I tried to follow some suggestion here
but seems like links are gone and not exactly sure how to delete or soft delete tables that are deprecated.
thanks in advance!
w
witty-state-99511
09/10/2021, 1:44 PMHey Jake! Welcome to DataHub!
witty-state-99511
09/10/2021, 1:47 PMManaging deprecated/removed tables is something we are working on.
m
mammoth-bear-12532
09/10/2021, 2:24 PM
@curved-daybreak-29035 there is some support for deleting metadata through rollbacks and urn based deletes. https://datahubproject.io/docs/how/delete-metadata/
mammoth-bear-12532
09/10/2021, 2:25 PM
In your case, as long as you can detect that a table has been deleted you can issue a soft delete through attaching the “Status(removed=true)” aspect.
c
curved-daybreak-29035
09/10/2021, 11:55 PMHey guys thanks for your reply! yes I managed to delete them through roll back but for the soft delete changing Statua to removed where can i do it? I couln’t find any explicit documentation about it, since im a newbie its quite hard to navigate through the system! Thanks in advance! @mammoth-bear-12532 @witty-state-99511
m
mammoth-bear-12532
09/11/2021, 12:03 AM
@curved-daybreak-29035: read through the documentation here. In particular there is a section on soft-deletion. https://datahubproject.io/docs/metadata-service#soft-deleting-an-entity
c
curved-daybreak-29035
09/11/2021, 12:09 AMthank you so much! @mammoth-bear-12532