Hi,
Datahub's ingestion cli seems to be importing...
# ingestionf
fierce-waiter-13795
03/11/2022, 7:01 AMHi,
Datahub's ingestion cli seems to be importing table/column descriptions if the data platform has the metadata. Is there any way to turn this feature off?
fierce-waiter-13795
03/11/2022, 7:01 AMAlso, I couldn't find any documentation for this
b
better-orange-49102
03/11/2022, 7:06 AMthere isn't a readily available method to turn it off.
better-orange-49102
03/11/2022, 8:22 AMthe easiest way is to write a transformer function to clear out the descriptions before its written to datahub
f
fierce-waiter-13795
03/11/2022, 8:30 AMAh okay, thanks for that
m
mammoth-bear-12532
03/11/2022, 5:33 PM
@fierce-waiter-13795: curious why you would want to turn it off, haven't heard this requirement before. Is it because the descriptions are not accurate?
f
fierce-waiter-13795
03/12/2022, 7:19 AMI'm looking for a way to manage/automate the ingestion of description/tags/terms into datahub(open to suggestions)
One way is to add them directly to the dataplatform and ingest using cli.
Another would be to save them all in a flat file(for ex) and load them using the python script.
I guess it would get messy if I wanted to switch approaches