Hi, Can I ingest metadata with just description fo...
# ingestion
r
Hi, Can I ingest metadata with just description for the tables located in separate file (tables columns/datatypes has already been ingested before from hive). Can i achieve it using API's/emitters? Is that possible? Can someone please provide me an example, please ?
g
Hey @rough-eye-60206! I think you may be looking for a transformer to solve this problem. Transformers let you enrich metadata via outside sources before sending it to Datahub. You will need to write a custom one in python to achieve this, but you can reference add_dataset_ownership or add_dataset_tags to see how these transformers work. This would also be a helpful thing to contribute back- if you write an add description via file transformer I'd love to help you contribute it back 🙂 More documentation on transformers here: https://datahubproject.io/docs/metadata-ingestion/transformers/
m
@rough-eye-60206, I know we talked about it yesterday. Does this clarify?
r
Thank you. I will through the docs and will give it a try.