I understand (or at least I think I understand) th...
# getting-started
a
I understand (or at least I think I understand) the version is populated by
gms
automatically. and I noticed that if I do add a version in Kafka message as such, it won't be respected in
mce
because of
renamed/avro/com/linkedin/mxe/MetadataChangeEvent.avsc
. here are two questions: 1. is my understanding correct? 2. can I add
version?
we try to backfill a aspect for datasets. we need to handle each version. What's best way to do so?
e
Your understanding of version is correct (i.e. it's auto-populated by DAO and not settable via MCE). You can backfill all the versions by sending MCEs in the chronological order. The latest version will always have
version = 0
a
can you elaborate that
you can backfill all the versions by sending MCEs in the chronological order
? I send the same message twice? My use case is that, for version 0, I calculated a score based on the aspects of this dataset. for version 1, I calculated a score based on this version's aspect. as you can see, the score has to be matched with each version.
b
If I understand correctly, you would not send the same message twice.. you’d have to replay the MCEs from the beginning of time to the time you want.. on each MCE you’d recalculate the score you’re referring to 🙂
a
OK. Thanks.