Hello! I'm new to DataHub, and I've been very impressed with the product so far! This is honestly exactly what I've been looking for. However, I'm currently having some issues ingesting from BigQuery with my GKE deployment. I've been desperately searching the channel looking for fixes but can't seem to find anything. • Deployed to GKE using helm • Running

acryl-datahub, version 0.8.27

• Port-forwarding datahub-datahub-frontend --> 9002 and datahub-datahub-gms --> 8080 • Currently have a working ingress for the frontend using my domain which was created by following the exact instructions from the docs. •

curl '<http://datahub.xxxx.xxxx/api/gms/config>'

returns nothing at the moment • Trying to ingest from BigQuery located in the same private project as my GKE instance Here is the recipe I created in the UI:

source:
    type: bigquery
    config:
        project_id: xxxxxxxxxxxx
        credential:
            project_id: xxxxxxxxxx
            private_key_id: xxxxxxxxxxx
            private_key: "-----BEGIN PRIVATE KEY-----xxxxxxxxxxxxxx-----END PRIVATE KEY-----\n"
            client_email: <mailto:xxxxxx@xxxxxxx.iam.gserviceaccount.com|xxxxxx@xxxxxxx.iam.gserviceaccount.com>
            client_id: 'xxxxxxxxxxx'
sink:
    type: datahub-rest
    config:
        server: '<http://datahub.xxxx.xxxx/api/gms>'

Keep receiving this error (did not include the entire stack trace)

'ConfigurationError: Unable to connect to <http://datahub.xxxx.xxx/api/gms/config> with status_code: 401. Maybe you need to set up 
authentication? Please check your configuration and make sure you are talking to the DataHub GMS (usually <datahub-gms-host>:8080) or 
Frontend GMS API (usually <frontend>:9002/api/gms).'

I've tried including an access token generated from the UI, but that still doesn't seem to give me the right authentication. Is this an authentication issue with GKE? Do I need to create an ingress for the datahub-gms service? I've tried quite a few combinations and I'm still very confused. Any help would be greatly appreciated. Thank you in advance!!!!

hi! you first have to enable the metadata authentication service

Yes, once you do that you will be good to proxy through the frontend 🙂

That worked! Thanks so much @numerous-camera-74294 @big-carpet-38439