Dear all, I am ingesting the metadata from Glue and it starts the load of data, but at some moment shows the next error message:

'/usr/local/bin/run_ingest.sh: line 26:  4036 Killed                  ( python3 -m datahub ingest -c "$4/$1.yml" )\n',
           "2022-09-28 14:04:23.217735 [exec_id=900d34f5-3632-4ada-a541-aa104a65e6ca] INFO: Failed to execute 'datahub ingest'",
           '2022-09-28 14:04:23.218122 [exec_id=900d34f5-3632-4ada-a541-aa104a65e6ca] INFO: Caught exception EXECUTING '

what could be a reason ? Thank you in advance!

We usually see this when the ingestion task runs out of memory and is killed by the operating system - could you try giving the datahub-actions container more memory?

sure, will try, thank you

Other people have had success with 500mb or 1gb, but it does largely depend on the source and the number of things we need to ingest from it

Thank you, it works

awesome!