Question: If some metadata already exists in Datah...
# ingestions
some-crayon-90964
11/24/2021, 4:28 PMQuestion: If some metadata already exists in Datahub and we try to ingest exactly the same metadata, ideally GMS should ignore the new version when we use the
EntityCliente
early-lamp-41924
11/24/2021, 4:34 PMYes!
early-lamp-41924
11/24/2021, 4:43 PMVersioning happens on an aspect level not entity level though. So if a certain aspect that you ingested is the same as the latest version of it, it will get ignored.
s
some-crayon-90964
11/25/2021, 12:41 AMbut looks like when we do it, the GMS doesnt ignore the same aspects for us
some-crayon-90964
11/25/2021, 12:41 AMwe run ingestion every 12 hours. Looks like every time GMS creates a new version.
some-crayon-90964
11/25/2021, 12:42 AMWhen you guys have time, can we hop on a call to help us figure out how to trigger the aspect checker?
some-crayon-90964
11/25/2021, 12:42 AMThanks
e
early-lamp-41924
11/26/2021, 8:57 AMUsually this happens when custom properties field has a timestamp in it.
early-lamp-41924
11/26/2021, 8:57 AMIts a holiday for us today and tomorrow. We can hop on a call on Monday!
s
some-crayon-90964
11/29/2021, 2:33 PM@early-lamp-41924 thanks for the hint. Let me do some exp myself to change the design on timestamp. I think we can hop on a call later if the time stamp doesnt fix it. Thanks!
2 Views