Hi team, tried running bigquery-usage recipe throu...
# ingestion
l
Hi team, tried running bigquery-usage recipe through ui, getting below error. can anyone help me with this??
Copy code
'typing-extensions-4.2.0 typing-inspect-0.7.1 tzdata-2022.1 tzlocal-4.2 urllib3-1.26.9 websocket-client-1.3.3 wrapt-1.14.1\n'
           '[2022-07-01 07:34:29,599] INFO     {datahub.cli.ingest_cli:99} - DataHub CLI version: 0.8.38.4\n'
           '[2022-07-01 07:34:30,173] INFO     {datahub.cli.ingest_cli:115} - Starting metadata ingestion\n'
           '[2022-07-01 07:44:41,592] INFO     {datahub.ingestion.source.usage.bigquery_usage:975} - Starting log load from GCP Logging\n'
           '/usr/local/bin/run_ingest.sh: line 26: 20382 Killed                  ( python3 -m datahub ingest -c "$4/$1.yml" )\n',
           "2022-07-01 07:49:20.890195 [exec_id=cceb1680-1556-4712-bc57-0b1d631836a3] INFO: Failed to execute 'datahub ingest'",
           '2022-07-01 07:49:20.890775 [exec_id=cceb1680-1556-4712-bc57-0b1d631836a3] INFO: Caught exception EXECUTING '
           'task_id=cceb1680-1556-4712-bc57-0b1d631836a3, name=RUN_INGEST, stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/default_executor.py", line 121, in execute_task\n'
           '    self.event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.9/site-packages/nest_asyncio.py", line 89, in run_until_complete\n'
           '    return f.result()\n'
           '  File "/usr/local/lib/python3.9/asyncio/futures.py", line 201, in result\n'
           '    raise self._exception\n'
           '  File "/usr/local/lib/python3.9/asyncio/tasks.py", line 256, in __step\n'
           '    result = coro.send(None)\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 115, in execute\n'
           '    raise TaskError("Failed to execute \'datahub ingest\'")\n'
           "acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"]}
s
Please share the following • the recipe in text format (instead of screenshots) masking the secrets • full logs in text format (instead of screenshots) from the ingestion that fails. Please do not remove any parts of the log (mask the secret if any secret is being shown)
l
s
Please try increasing the memory of the actions pod
It was killed. Usually it gets killed if memory usage has passed the limits set
l
cool, will try it out. actions pod as in gms pod because i am using gms ip port as sink??
s
no there is a separate actions pod