Hey all not sure if this is the right place to be asking thi DataHub #ingestion

Hey all, not sure if this is the right place to be...

big-zoo-81740

08/02/2022, 1:56 PM

Hey all, not sure if this is the right place to be asking this, but I'm setting up lookml ingestion and keep getting an error saying that the directory is not found. I'm using the directory of my lookml repo/files using the

base_folder

config option,

/home/ubuntu/github/myreponame

, but I keep getting an error saying it can't find the directory or it doesn't exist. The folder has r/w permissions, so datahub should be able to read from it. Is there something I am obviously doing wrong? Does the repo need to be located in a specific folder in order for the

base_folder

config to be able to read from it?

gentle-hamburger-31302

08/02/2022, 2:01 PM

Hi @big-zoo-81740 Could you please share your recipe and datahub version

big-zoo-81740

08/02/2022, 2:19 PM

Hey @gentle-hamburger-31302, sure thing. Recipe is below and we're on datahub v0.8.4.1.

Copy code

source:
    type: lookml
    config:
        base_folder: /home/ubuntu/github/
        api:
            base_url: '<https://looker.ourcompanyname.com>'
            client_id: '${LOOKER_CLIENT_ID}'
            client_secret: '${LOOKER_CLIENT_SECRET}'

big-zoo-81740

08/02/2022, 2:44 PM

@gentle-hamburger-31302 does the directory need to be within docker's directory or something like that? I.e. like a VM that can't see local directories?

mammoth-bear-12532

08/09/2022, 10:59 PM

Hey @big-zoo-81740: are you running the ingestion from the docker container? if so the folder needs to be readable from the container. Are you familiar with docker mounts?

Open in Slack

Previous Next