Hi all, I'm getting started with Datahub, but during metadata ingestion for BigQuery I got the following error.

'NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fe02a7ef100>: Failed to establish a new connection: [Errno 111] '
           'Connection refused\n'
           '\n'   
"MaxRetryError: HTTPConnectionPool(host='localhost', port=9002): Max retries exceeded with url: /api/gms/config (Caused by "
           "NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fe02a7ef100>: Failed to establish a new connection: [Errno 111] "
           "Connection refused'))\n"
           '\n'

Can somebody please help me rectify this.

Can you check if datahub gms container is up and running? It seems like you can't connect to it.

Could you also share your recipe?

Hi @dazzling-judge-80093, yes my datahub gms container is up and running.

Hey @polite-application-51650 - how did you come up with that server value? try

<http://localhost:8080>

@green-football-43791, I tried with

localhost:8080

too.

This is how the sink should look like in the recipe if you use with the quickstart ->

sink:
  type: "datahub-rest"
  config:
    server: "<http://localhost:8080>"

Docker logs

11:35:06.214 [generic-mae-consumer-job-client-0-C-1] INFO  c.l.m.kafka.hook.UpdateIndicesHook:175 - Here's the relationship types found [ingestionSource]

11:35:06.218 [qtp544724190-13] INFO  c.l.m.r.entity.AspectResource:125 - INGEST PROPOSAL proposal: {aspectName=dataHubExecutionRequestResult, entityKeyAspect={contentType=application/json, value=ByteString(length=46,bytes=7b226964...3739227d)}, entityType=dataHubExecutionRequest, aspect={contentType=application/json, value=ByteString(length=51,bytes=7b227374...3231327d)}, changeType=UPSERT}

11:35:06.245 [pool-9-thread-1] INFO  c.l.m.filter.RestliLoggingFilter:55 - POST /aspects?action=ingestProposal - ingestProposal - 200 - 27ms

11:35:06.266 [generic-mae-consumer-job-client-0-C-1] INFO  c.l.m.kafka.hook.UpdateIndicesHook:175 - Here's the relationship types found []

11:35:06.268 [I/O dispatcher 1] INFO  c.l.m.s.e.update.BulkListener:28 - Successfully fed bulk request. Number of events: 1 Took time ms: -1

11:35:06.271 [generic-mae-consumer-job-client-0-C-1] INFO  c.l.m.kafka.hook.UpdateIndicesHook:175 - Here's the relationship types found []

11:35:07.274 [I/O dispatcher 1] INFO  c.l.m.s.e.update.BulkListener:28 - Successfully fed bulk request. Number of events: 5 Took time ms: -1

11:36:45.838 [qtp544724190-18] INFO  c.l.m.r.entity.AspectResource:125 - INGEST PROPOSAL proposal: {aspectName=dataHubExecutionRequestResult, entityKeyAspect={contentType=application/json, value=ByteString(length=46,bytes=7b226964...3739227d)}, entityType=dataHubExecutionRequest, aspect={contentType=application/json, value=ByteString(length=54089,bytes=7b227374...5c6e227d)}, changeType=UPSERT}

11:36:45.872 [pool-9-thread-1] INFO  c.l.m.filter.RestliLoggingFilter:55 - POST /aspects?action=ingestProposal - ingestProposal - 200 - 35ms

11:36:45.880 [generic-mae-consumer-job-client-0-C-1] INFO  c.l.m.kafka.hook.UpdateIndicesHook:175 - Here's the relationship types found []

11:36:46.265 [I/O dispatcher 1] INFO  c.l.m.s.e.update.BulkListener:28 - Successfully fed bulk request. Number of events: 2 Took time ms: -1

@polite-application-51650 @dazzling-judge-80093 @green-football-43791 Hi, have you managed to find a resolution to this issue? I'm having same issues like Ankit had but only when trying to create an ingestion from DataHub UI (also from bigquery to rest). @green-football-43791 regarding your message from 20 days ago regarding

<http://localhost:9002/api/gms>

vs

<http://localhost:8080>

: when one creates a source in UI, the UI actually shows localhost:9002 instead of 8080. Do you know what might be the reason for this one?

try

<http://datahub-gms:8080/>

@polite-application-51650 nope, doesn't work apparently it works now, thanks 😅