Hi All, I am exploring Datahub. so far was success...
# ingestion
m
Hi All, I am exploring Datahub. so far was successful in checking the lineage . it was great. Now, we would like to ingest tags and short description using an input flat file without having to do it individually for every data set. is there any solution already for this ? please help on this. please share any useful threads. links or feel free to DM for more clarity. thank you !
👍 1
g
There’s a couple ways to do this: • write a standalone script that simply emits this information using the emitters https://datahubproject.io/docs/metadata-ingestion/ • write a standalone script that modifies the data - here’s an example; https://github.com/linkedin/datahub/blob/master/metadata-ingestion/examples/demo_data/enrich.py • build a transformer to add this info during ingestion - see this thread for details https://datahubspace.slack.com/archives/CUMUWQU66/p1625860098041300?thread_ts=1625740971.025800&cid=CUMUWQU66