I am newbie in this space and one question i had is how can i implement RDBMS schema ingestion using push model. Ex the https://datahubproject.io/docs/metadata-ingestion document talks about how it can scan mysql database and publish all the databases, tables, schema... Can it generate a change log (ex. column x is added to table A) or i will have implement something myself. Ex. listen to schema changes in mysql using tools like debezium and when i receive a new event for say schema change use it for publishing to datahub. I really like the datahub project so thank you for creating this wonderful technology thanks

Awesome idea! I guess one way would be to have intermediate kafka consumer/producer that listens to change events and produces Metadata change events that datahub understands

This is definitely possible 🙂 though not implemented currently.

Thanks. I would love to work on/implement this idea. Any suggestion on what would be the right way to engage ?

I’ll DM you @numerous-cricket-19689 and we can brainstorm together