hi ! my team and I would like to implement a gitlab CI/CD job to ingest dbt data to datahub. Does anyone have some tips on how to do this ?
m
mammoth-bear-12532
07/22/2022, 5:59 AM
As long as you have a way to produce a manifest.json and catalog.json files from the dbt runner, you should be able to add on another job that just takes these files and ships them to datahub by using a docker container.
plus1 1
b
best-leather-7441
07/22/2022, 10:13 AM
thank you ! i've just started so this tip is quite useful