Hello, i'm a noob to datahub. I've deployed datahu...
# ingestion
n
Hello, i'm a noob to datahub. I've deployed datahub on GKE, and i'm trying to ingest bigquery metadata via
datahub-rest
. The app (datahub) and bigquery are on same privatea project. When i try sink through console or sink through file, it succeeds without error . However, sink through datahub-rest fails with
ConnectionError
☹️ Is there something i'm missing? Here's my recipe...
Copy code
source:
  type: bigquery
  config:
    project_id: <my_project_id>

sink:
  type: "datahub-rest"
  config:
    server: "<http://localhost:8080>"
error message :
Copy code
ConnectionError: HTTPConnectionPool(host='localhost', port=8080): Max retries exceeded with url: /config (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x10ba85d00>: Failed to establish a new connection: [Errno 61] Connection refused'
Here's my trials& errors... • ingress address → This version of acryl-datahub requires GMS v0.8.0 or higher • port forwarding datahub-front 9002:9002 → This version of acryl-datahub requires GMS v0.8.0 or higher • options → credentials_path → same connection error
Sorry guys i just figured out 😅 i was port-forwarding the wrong way. FYI : you need to port forward datahub-gms 8080:8080... duh 😞
m
Glad you could figure it out on your own @nice-planet-17111 ! And welcome :)
❤️ 1