Hi guys, I don't have a complete set of data, just metadata (including fieldname and description). Is there anyway I can use datahub to ingest this metadata (csv format) into objects? thanks
✅ 1
b
better-orange-49102
05/26/2023, 10:15 AM
Csv enricher does not work if the entity is not already in datahub. Probably have to use the sdk or openapi to create the entities.
c
colossal-exabyte-39072
05/26/2023, 10:20 AM
thanks I'll look into it
b
big-carpet-38439
05/31/2023, 9:52 PM
Hi @colossal-exabyte-39072! You can certainly do this in a few ways.
1. Use our python SDK to manually emit aspects for the entities you want to ingest
2. Use our "file" source to ingest JSON-encoded "MetadataChangeProposal" objects, which are just aspects for custom entities. We actually do this for the initial bootstrap of datahub and you can refer to this file for example JSON objects: https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/examples/mce_files/bootstrap_mce.json