Hello, Im trying to ingest dbt and I ran the inges...
# ingestion
r
Hello, Im trying to ingest dbt and I ran the ingest recipe command. I then got this as a response, why is it an error??
Copy code
ERROR    {datahub.entrypoints:165} - You seem to have connected to the frontend instead of the GMS endpoint. The rest emitter should connect to DataHub GMS (usually <datahub-gms-host>:8080) or Frontend GMS API (usually <frontend>:9002/api/gms)
Also what am I to expect if i get dbt working? Will i see the lineage in datahub similar to what dbt shows?
h
Hi @rhythmic-flag-69887 can you please share your recipe sink config ? Are you using datahub cli to run the recipe ?
r
@hundreds-photographer-13496 Yes Im using the cli
Copy code
source:
  type: "dbt"
  config:
    # Coordinates
    manifest_path: "/Users/gab/Documents/Code/dbt-tables/target/manifest.json"
    catalog_path: "/Users/gab/Documents/Code/dbt-tables/target/catalog.json"
    sources_path: "/Users/gab/Documents/Code/dbt-tables/target/sources.json"

    # Options
    target_platform: "postgres" # e.g. bigquery/postgres/etc.
    load_schemas: True # note: if this is disabled
    stateful_ingestion.state_provider.type: datahub
    aws_connection.aws_region: ap-southeast-1

sink:
  # sink configs
  type: 'datahub-rest'
  config:
   server: ""
h
have you set empty value for server config ? You need to set it to <datahub-gms-host>:8080, for example http://localhost:8080 if you are using
datahub docker quickstart
How did you deploy your datahub instance ?
r
oh i just hid the host, il ask how they set it up, all they(the team that set it up) mentioned was that they used helm (im not familiar with that) to host it on kubernetes cluster