We had a use case which I was hoping to solve after we have a metadata store/data discovery tool up. Wanted to understand if this workflow can be done through datahub.
We have different eng teams. Some for different business themes, countries etc. Each of them is managing their own databases (mostly RDS). Data team has access to read replicas of all of them. Any of the teams can change the schema in their own databases. Ideally, we would like the data team to be aware of any schema changes as soon as they happen. With the schema ingestion we will have history of schema changes which can be viewed if we go to individual dataset.
Is there a way to have a running history of schema changes in a single place (excluding the first ingestion when we add these assets into datahub)? This can be a good tool for the whole data team to stay up-to-date with schema changes that various teams are doing.