Hello, I am looking to understand the codebase in ...
# ingestion
c
Hello, I am looking to understand the codebase in the
metadata-models
repo and have the following question: I notice that
upstreamLineage
is a dataset aspect but that it is not listed in the aspects list for dataset in the `entity-registry.yaml`; can someone advise how this is the case? • https://github.com/datahub-project/datahub/blob/master/metadata-models/src/main/pegasus/com/linkedin/dataset/UpstreamLineage.pdlhttps://github.com/datahub-project/datahub/blob/master/metadata-models/src/main/resources/entity-registry.yml Edit: in general, I see that the aspects under
metadata-models/src/main/pegasus/com/linkedin/dataset
correspond to the aspects below, but the
entity-registry.yaml
doesn't seem to correspond with this • https://datahubproject.io/docs/generated/metamodel/entities/dataset#aspects
m
Hey @colossal-sandwich-50049 yes we're aware this is confusing. The entity-registry is actually merged with the snapshot models coming from the MetadataChangeEvents to create a combined registry that powers the graph.. and e.g. our generated metamodel docs.
I just filed an issue to backfill all the historical aspects into the entity-registry so this is not confusing
c
Thank you @mammoth-bear-12532!
c
did this ever get fixed?
m
yup, entity-registry is now fully populated
c
oh great! not sure what i was looking at before, must have been an old branch