Hey guys! I'm having an issue right now. I'm using dbt core and trying to add the source to datahub, and I have installed datahub on docker and dbt core locally, both on the same virtual machine. Then the error came out. I'm very confused why the folder can't be found, cause they are literally on the same server...Is there anyone trying to ingest from dbt?

if u mean u’re running your docker containers in the same VM as DBT then that’s not good enough. Docker is designed to be independent of the host machine (in this case, your VM). You can probably run some mounted volume so that its visible on both host and container OR found some other way to share the data likeNFS or something.

Thanks for the reply. So under this circumstance, should I seperate DBT and docker or have a try on running a mounted volume to see if it would work?

I’m not working with DBT myself, but if u just want dbt and datahub to read the same file then mounted volumes could help, though it seems to me there ought to be another way of doing this that doesn’t relies on reading files from the filesystem

I have googled a lot, but it seems only a few people work with DBT. SInce I'm using mysql as database, DBT is easier to generate the lineage of tables and then import into DataHub. I'll try mounted volumes first. Appreciate！

I will be using DBT in the near future but right now there’s not much I can tell u 🤷

btw, as you see there are three containers on my VM, do you have any idea about which one should the DBT folder be mounted?

my guess would be

gms

It should be. I'll try it. Tjhanks!