A little conceptual clarification needed, does Lineage of data also shows me the changes I made to a specific field of database? Suppose for example I deleted/modified a field in Glue, will the Lineage section show me the modifications?
l
loud-island-88694
05/18/2021, 4:19 PM
Field level lineage is being worked on and is coming sometime in July. At the moment, dataset lineage is supported. However, the question you are asking is more about schema changes over time
loud-island-88694
05/18/2021, 4:20 PM
we do maintain historical versions of schemas and will soon add the ability to visualize previous versions so you can know which fields have been deleted/altered over time
❤️ 5
loud-island-88694
05/18/2021, 4:20 PM
let me know if that addresses your use-case
c
colossal-furniture-76714
05/20/2021, 11:53 AM
historial versions of schemas will be a great feature.
m
many-egg-4654
05/22/2021, 3:37 PM
Yes, That does addresses my use-case. Would be great to have it in datahub!