How do we enable versioning in captured metadata? ...
# ingestion
w
How do we enable versioning in captured metadata? 1. In the push mode, can the MCE emitter specify the same version for an existing dataset definition to override the DatasetSnapshot present in DataHub? 2. In the pull mode, is it possible for DataHub to create a new version of DatasetSnapshot if there were any changes in the definition? e.g. a field name's type has been changed from int to string in a mongodb collection?
m
@witty-keyboard-20400 sorry for the delay in responding to this. Regardless of pull or push, DataHub will always diff with what it has locally and mint a new version if needed. So yes… in the case you mentioned, if there is a new field or the type of the field has changed, datahub will create a new version.
1