A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi Team - I have question that Let Say I have transferred metadata from s3 delta lake number time . I want see which is latest data transfer , what will be option for same ? is there any timestamp there ?   ...another thing how verify weather ingested metadata has no loss ?

We store all timestamps in the mysql database

there is the `createdat` column which stores when the metadata was first ingested

if the metadata is seen multiple times, then in the `systemmetadata` column you will find a `lastUpdated` timestamp in the metadata json payload