Hello everyone, I want to use git and datahub for version control, But I have no idea how to structure this. The point is to have a git repository so I can know what recipes have been ingested and how(whether it was through the REST API or something else). I need to keep track of what metadata is being ingested in our office datahub and how. Eg: I have some glossary_term.yml file that I ingested into datahub but I would like to add CI/CD so that this happens automatically whenever it is updated. Any suggestions?

have you considered using github actions? https://docs.github.com/en/actions

Yes, but I would like to confirm if this aligns with the best practices. Should I put everything in one repository? because the metadata comes from several different projects.

Yes we recommend having a Github action which is capable of pushing changes in glossary term YAML, lineage, or any other hand-written metadata files into DataHub! Currently this process is manual, but we would love a contribution for some general purpose github actions 🙂