Hi guys, Using DH 0.9.3.2. Just made a postgres ingestions. On the middle of the ingestion work, it fails with a weird error:

'/usr/local/bin/run_ingest.sh: line 40:   467 Killed                  ( datahub ${debug_option} ingest run -c "${recipe_file}" '
           '${report_option} )\n',
           "2022-12-22 14:43:24.766921 [exec_id=b0e5bc27-9d53-46e6-b866-f388b73cac96] INFO: Failed to execute 'datahub ingest'",
           '2022-12-22 14:43:24.771317 [exec_id=b0e5bc27-9d53-46e6-b866-f388b73cac96] INFO: Caught exception EXECUTING '
           'task_id=b0e5bc27-9d53-46e6-b866-f388b73cac96, name=RUN_INGEST, stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/default_executor.py", line 123, in execute_task\n'
           '    task_event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.10/asyncio/base_events.py", line 646, in run_until_complete\n'
           '    return future.result()\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 227, in execute\n'
           '    raise TaskError("Failed to execute \'datahub ingest\'")\n'
           "acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"]}
Execution finished with errors.

The metadata ingesting worked well. All tables and columns are ingested. Some of the profiling works aswell (the tables that the ingestion finished profiling shows row count etc). Any thoughts of how I can understand what the problem was? Thank you.

This usually happens if your container runs out of memory. Can you provide more memory to it?

Ah yes! It seems that our ingestion task has run out. You must have many things inside Postgres 😛

Interesting. I'm running on a linux EC2, with 16gb ram (as the documentation stated as minimum requirements) I guess I need more? or either split the ingestion into smaller sizes?

Do you run it in Docker? Please, can you check how much memory docker has and increase it?

Sorry, forgot to mention i'm using the quickstart build, I didn't start the docker itself