Amir Brohi
03/26/2024, 12:49 PMedr send-report --google-service-account-path service-keyfile.json --gcs-bucket-name gcs-bucket-name --bucket-file-path data-health-report.html --update-bucket-website true
dbt packages/modules info
running on python 3.8.13
dbt-core==1.7.0
elementary-data[bigquery]==0.14.1
- package: dbt-labs/dbt_utils
version: 1.1.1
- package: elementary-data/elementary
version: 0.14.0
unfortunately, i’m unable to reproduce this error locally - only fails when running via cloud run job (GCP service).
any pointers will be much appreciated - thanks!Amir Brohi
03/26/2024, 12:51 PM— ERROR — Could not generate the report - Error: Failed to run dbt command.
Traceback (most recent call last):
File "/home/dbtuser/venv/lib/python3.8/site-packages/elementary/clients/dbt/dbt_runner.py", line 88, in _run_command
result = subprocess.run(
File "/usr/local/lib/python3.8/subprocess.py", line 516, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_test_results", "macro_args": {"days_back": 7, "invocations_per_test": 720, "disable_passed_test_metrics": false}}', '--project-dir', '/home/dbtuser/venv/lib/python3.8/site-packages/elementary/monitor/dbt_project']' died with <Signals.SIGKILL: 9>.
Traceback (most recent call last):
File "/home/dbtuser/venv/lib/python3.8/site-packages/elementary/monitor/api/report/report.py", line 50, in get_report_data
tests_api = TestsAPI(
File "/home/dbtuser/venv/lib/python3.8/site-packages/elementary/monitor/api/tests/tests.py", line 39, in __init__
self.test_results_db_rows = self._get_test_results_db_rows(
File "/home/dbtuser/venv/lib/python3.8/site-packages/elementary/monitor/api/tests/tests.py", line 51, in _get_test_results_db_rows
return self.tests_fetcher.get_all_test_results_db_rows(
File "/home/dbtuser/venv/lib/python3.8/site-packages/elementary/monitor/fetchers/tests/tests.py", line 22, in get_all_test_results_db_rows
run_operation_response = self.dbt_runner.run_operation(
File "/home/dbtuser/venv/lib/python3.8/site-packages/elementary/clients/dbt/dbt_runner.py", line 160, in run_operation
success, command_output = self._run_command(
File "/home/dbtuser/venv/lib/python3.8/site-packages/elementary/clients/dbt/dbt_runner.py", line 99, in _run_command
raise DbtCommandError(err, command_args, logs=logs)
elementary.exceptions.exceptions.DbtCommandError: Failed to run dbt command.Noy Arie
03/26/2024, 5:24 PMdied with <Signals.SIGKILL: 9>. and it looks like the most common cause is out of memory issue. Is it possible that your machine runs out of memory?Amir Brohi
03/27/2024, 10:36 AM