I don’t get it. `version 0.8.25` Running `docke...
# ingestion
m
I don’t get it.
version 0.8.25
Running
docker QuickStart
on Linux and connecting thru Chrome on a MBP, adding an ingestion thru the web application. Choosing
Execute
fails. Why is this failing:
Copy code
sink:
    type: datahub-rest
    config:
        server: '<http://localhost:8080>'
Log shows:
Copy code
"ConnectionError: HTTPConnectionPool(host='localhost', port=8080): Max retries exceeded with url: /config (Caused by "
           "NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fae83a81a30>: Failed to establish a new connection: [Errno 111] "
           "Connection refused'))\n",
           "2022-02-09 00:27:27.263935 [exec_id=e989b898-fb4d-4eec-9d9c-965a78650cb9] INFO: Failed to execute 'datahub ingest'",
           '2022-02-09 00:27:27.269727 [exec_id=e989b898-fb4d-4eec-9d9c-965a78650cb9] INFO: Caught exception EXECUTING '
           'task_id=e989b898-fb4d-4eec-9d9c-965a78650cb9, name=RUN_INGEST, stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/default_executor.py", line 119, in execute_task\n'
           '    self.event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.9/site-packages/nest_asyncio.py", line 81, in run_until_complete\n'
           '    return f.result()\n'
           '  File "/usr/local/lib/python3.9/asyncio/futures.py", line 201, in result\n'
           '    raise self._exception\n'
           '  File "/usr/local/lib/python3.9/asyncio/tasks.py", line 256, in __step\n'
           '    result = coro.send(None)\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 115, in execute\n'
           '    raise TaskError("Failed to execute \'datahub ingest\'")\n'
           "acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"]}
Curl shows:
Copy code
curl <http://localhost:8080/config>
{
  "models" : { },
  "versions" : {
    "linkedin/datahub" : {
      "version" : "v0.8.25",
      "commit" : "306fe0b5ffe3e59857ca5643136c8b29d80d4d60"
    }
  },
  "statefulIngestionCapable" : true,
  "retention" : "true",
  "noCode" : "true"
}
What am I missing??
m
@mysterious-portugal-30527: since the ingestion system is running in the docker network, you need to give it the docker hostname for datahub gms, which is
datahub-gms
. So the sink config should be :
Copy code
config:
   server: "<http://datahub-gms:8080>"
I know its confusing, we're looking into how to make the default be configurable based on where the datahub system is running.
m
ah! The secret sauce! That worked wonderfully! Thanks for the assist!
🎉 1