Title
p

prehistoric-optician-40107

03/22/2022, 11:10 AM
Hi all. I'm trying to learn datahub and I'm having trouble ingestion metadata via UI. I was able to get my metadata via yml file but not via UI. This is my execution details. How can I fix this ?
"ConnectionError: HTTPConnectionPool(host='localhost', port=8080): Max retries exceeded with url: /config (Caused by "
           "NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb58e5d14f0>: Failed to establish a new connection: [Errno 111] "
           "Connection refused'))\n",
           "2022-03-16 11:30:30.325290 [exec_id=d287226a-592b-4029-879a-583a3cfa64eb] INFO: Failed to execute 'datahub ingest'",
           '2022-03-16 11:30:30.325765 [exec_id=d287226a-592b-4029-879a-583a3cfa64eb] INFO: Caught exception EXECUTING '
           'task_id=d287226a-592b-4029-879a-583a3cfa64eb, name=RUN_INGEST, stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/default_executor.py", line 119, in execute_task\n'
           '    self.event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.9/site-packages/nest_asyncio.py", line 81, in run_until_complete\n'
           '    return f.result()\n'
           '  File "/usr/local/lib/python3.9/asyncio/futures.py", line 201, in result\n'
           '    raise self._exception\n'
           '  File "/usr/local/lib/python3.9/asyncio/tasks.py", line 256, in __step\n'
           '    result = coro.send(None)\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 115, in execute\n'
           '    raise TaskError("Failed to execute \'datahub ingest\'")\n'
           "acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"]}
Execution finished with errors.
d

dazzling-judge-80093

03/22/2022, 11:51 AM
from the docker container you need to use
datahub-gms:8080
instead of localhost to access gms server.
p

prehistoric-optician-40107

03/22/2022, 12:44 PM
If I understood correctly, I need to write
datahub-gms:8080
in sink, but when I do, I get this error.
'OperationalError: (psycopg2.OperationalError) connection to server at "localhost" (127.0.0.1), port 5432 failed: Connection refused\n'
           '\tIs the server running on that host and accepting TCP/IP connections?\n'
           'connection to server at "localhost" (::1), port 5432 failed: Cannot assign requested address\n'
           '\tIs the server running on that host and accepting TCP/IP connections?\n'
           '\n'
           '(Background on this error at: <http://sqlalche.me/e/13/e3q8>)\n',
           "2022-03-22 12:43:09.452962 [exec_id=542d4935-cab2-471f-97d3-9e6394f0bad6] INFO: Failed to execute 'datahub ingest'",
           '2022-03-22 12:43:09.453384 [exec_id=542d4935-cab2-471f-97d3-9e6394f0bad6] INFO: Caught exception EXECUTING '
           'task_id=542d4935-cab2-471f-97d3-9e6394f0bad6, name=RUN_INGEST, stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/default_executor.py", line 119, in execute_task\n'
           '    self.event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.9/site-packages/nest_asyncio.py", line 81, in run_until_complete\n'
           '    return f.result()\n'
           '  File "/usr/local/lib/python3.9/asyncio/futures.py", line 201, in result\n'
           '    raise self._exception\n'
           '  File "/usr/local/lib/python3.9/asyncio/tasks.py", line 256, in __step\n'
           '    result = coro.send(None)\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 115, in execute\n'
           '    raise TaskError("Failed to execute \'datahub ingest\'")\n'
           "acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"]}
Execution finished with errors.
I am using this recipe. Is there a mistake in the recipe?
source:
    type: postgres
    config:
        host_port: 'localhost:5432'
        database: MyDatabase
        username: postgres
        password: 1234567
sink:
    type: datahub-rest
    config:
        server: '<http://datahub-gms:8080>'
b

better-orange-49102

03/22/2022, 12:51 PM
Now the container running ingestion is saying it can't connect to the postgres server. Where is your postgres server located? On a container on the same server running datahub? Or a running process on the same server running datahub?