Hi Team,
of late, we are seeing a lot more failure...
# community-supportm
manish ramrakhiani
12/05/2023, 3:57 PMHi Team,
of late, we are seeing a lot more failures while generating the report. We are on the latest 0.13.0 version and sometimes the report generation works just fine and some times we get the attached failure.
Any help is much appreciated 🙏
✅ 1
n
Noa Kurman
12/06/2023, 8:48 AMHey @manish ramrakhiani ! Thanks for reaching out
First of all there was a hotfix release right now that might help your case, can you upgrade to 0.13.1 and test it again?
Also if it doesn’t work, can you share your
edr.logm
manish ramrakhiani
12/06/2023, 9:07 AMSure Noa, I will try 🙏
manish ramrakhiani
12/07/2023, 2:48 PMHi @Noa Kurman
Upgraded to 0.13.1 but the report still keeps failing and all I see in edr.log is this.
Copy code
[31;20m2023-12-08 10:42:38 — ERROR — Could not generate the report - Error: Failed to run dbt command.
Please reach out to our community for help with this issue.[0m
NoneType: None
2023-12-08 10:42:59 — INFO — Running with edr=0.13.2
2023-12-08 10:42:59 — DEBUG — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_latest_invocation", "macro_args": {}} --project-dir /usr/local/lib/python3.9/dist-packages/elementary/monitor/dbt_project --target prod
2023-12-08 10:43:08 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_latest_invocation", "macro_args": {}}', '--project-dir', '/usr/local/lib/python3.9/dist-packages/elementary/monitor/dbt_project', '--target', 'prod']' is 10050
2023-12-08 10:43:08 — DEBUG — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_adapter_type_and_unique_id", "macro_args": {}} --project-dir /usr/local/lib/python3.9/dist-packages/elementary/monitor/dbt_project --target prod
2023-12-08 10:43:15 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_adapter_type_and_unique_id", "macro_args": {}}', '--project-dir', '/usr/local/lib/python3.9/dist-packages/elementary/monitor/dbt_project', '--target', 'prod']' is 1514
2023-12-08 10:43:15 — INFO — edr (0.13.2) and Elementary's dbt package (0.13.0) are compatible.
2023-12-08 10:43:15 — DEBUG — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_elementary_database_and_schema", "macro_args": {}} --project-dir /usr/local/lib/python3.9/dist-packages/elementary/monitor/dbt_project --target prod
2023-12-08 10:43:22 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_elementary_database_and_schema", "macro_args": {}}', '--project-dir', '/usr/local/lib/python3.9/dist-packages/elementary/monitor/dbt_project', '--target', 'prod']' is 1476
2023-12-08 10:43:22 — INFO — Elementary's database and schema: '"SDM_PROD.ELEMENTARY"'
2023-12-08 10:43:22 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_test_results", "macro_args": {"days_back": 7, "invocations_per_test": 720, "disable_passed_test_metrics": false}} --project-dir /usr/local/lib/python3.9/dist-packages/elementary/monitor/dbt_project --target prodm
Maayan Salom
12/10/2023, 5:47 PMHey @manish ramrakhiani,
Sorry for the late reply here.
Config seems to be ok, in the past this error usually indicated a time out in generating the report.
Does it sometime work?
You can try running with
--executions-limitm
manish ramrakhiani
12/10/2023, 5:55 PMAha..Thanks @Maayan Salom. I will try that.
Yes, previously it failed intermittently then we added retry for 5 times while invoking the edr and it worked for a while.
But lately, it has been failing consistently
manish ramrakhiani
12/11/2023, 9:16 AMThank you Maayan, setting
--executions-limit🐕 1
36 Views