https://linen.dev logo
Join Slack
Powered by
Hi Elementry team. We’re updating our DBT & El...
# community-support
h
Hi Elementry team. We’re updating our DBT & Elementry to version 
1.7.1
& 
0.14.0
respectively. However, the 
edr
command is failing now when it’s run on airflow using `KubernetesPodOperator`:
Copy code
edr monitor send-report --profiles-dir ... --profile-target ... --gcs-bucket-name ... --bucket-file-path ... --days-back 7 --executions-limit 200 --project-name ... --env ...
Here’s the log:
Copy code
[2024-03-12, 11:14:24 UTC] {pod_manager.py:431} INFO - [base] You are using Elementary 0.14.0, however version 0.14.1 is available.
[2024-03-12, 11:14:24 UTC] {pod_manager.py:431} INFO - [base] Consider upgrading by running: "/usr/local/bin/python -m pip install --upgrade elementary-data"
2024-03-12T11:14:24.724790095Z 

[2024-03-12, 11:14:24 UTC] {pod_manager.py:431} INFO - [base] Any feedback and suggestions are welcomed! join our community here - <https://bit.ly/slack-elementary>
2024-03-12T11:14:24.726469855Z 

[2024-03-12, 11:14:24 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:24 — INFO — Running with edr=0.14.0
[2024-03-12, 11:14:24 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:24 — INFO — Installing packages for edr internal dbt package...
[2024-03-12, 11:14:32 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:24 — INFO — Running dbt --log-format json deps --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project --profiles-dir /dbt/profile/ --target acceptance
[2024-03-12, 11:14:32 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:32 — INFO — Running with dbt=1.7.3
[2024-03-12, 11:14:32 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:32 — INFO — Updating lock file in file path: /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project/package-lock.yml
[2024-03-12, 11:14:32 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:32 — INFO — Installing dbt-labs/dbt_utils
[2024-03-12, 11:14:32 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:32 — INFO — Installed from version 0.8.6
[2024-03-12, 11:14:32 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:32 — INFO — Updated version available: 1.1.1
[2024-03-12, 11:14:32 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:32 — INFO — Installing elementary-data/elementary
[2024-03-12, 11:14:32 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:32 — INFO — Installed from version 0.14.0
[2024-03-12, 11:14:32 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:32 — INFO — Updated version available: 0.14.1
[2024-03-12, 11:14:32 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:32 — INFO —
[2024-03-12, 11:14:32 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:14:32 — INFO — Updates available for packages: ['dbt-labs/dbt_utils', 'elementary-data/elementary']
[2024-03-12, 11:15:16 UTC] {pod_manager.py:431} INFO - [base] Update your versions in packages.yml, then run dbt deps
[2024-03-12, 11:15:16 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:15:16 — INFO — Elementary's database and schema: '...'
[2024-03-12, 11:18:33 UTC] {pod_manager.py:431} INFO - [base] 2024-03-12 11:15:16 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_test_results", "macro_args": {"days_back": 7, "invocations_per_test": 200, "disable_passed_test_metrics": false}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project --profiles-dir /dbt/profile/ --target acceptance
[2024-03-12, 11:18:33 UTC] {pod_manager.py:431} INFO - [base] [31;20m2024-03-12 11:18:33 — ERROR — Could not generate the report - Error: Failed to run dbt command.
[2024-03-12, 11:18:33 UTC] {pod_manager.py:431} INFO - [base] Please reach out to our community for help with this issue.[0m
[2024-03-12, 11:18:33 UTC] {pod_manager.py:431} INFO - [base] Traceback (most recent call last):
[2024-03-12, 11:18:33 UTC] {pod_manager.py:431} INFO - [base]   File "/usr/local/lib/python3.10/site-packages/elementary/clients/dbt/dbt_runner.py", line 88, in _run_command
[2024-03-12, 11:18:33 UTC] {pod_manager.py:431} INFO - [base]     result = subprocess.run(
[2024-03-12, 11:18:33 UTC] {pod_manager.py:431} INFO - [base]   File "/usr/local/lib/python3.10/subprocess.py", line 524, in run
[2024-03-12, 11:18:33 UTC] {pod_manager.py:431} INFO - [base]     raise CalledProcessError(retcode, process.args,
[2024-03-12, 11:18:33 UTC] {pod_manager.py:431} INFO - [base] subprocess.CalledProcessError: Command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_test_results", "macro_args": {"days_back": 7, "invocations_per_test": 200, "disable_passed_test_metrics": false}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project', '--profiles-dir', '/dbt/profile/', '--target', 'acceptance']' died with <Signals.SIGKILL: 9>.
2024-03-12T11:18:33.163400540Z
Here’s the Dockerfile that is used to run the command on:
Copy code
FROM <http://ghcr.io/dbt-labs/dbt-snowflake:1.7.1|ghcr.io/dbt-labs/dbt-snowflake:1.7.1>

ENV DBT_PROFILES_DIR=/dbt/profile/

COPY /dbt /dbt
WORKDIR /dbt

RUN pip install -U pip
RUN pip install -r requirements.txt

# Install packages in packages.yml
RUN dbt deps
& packages.yml:
Copy code
packages:
  - package: dbt-labs/dbt_utils
    version: 1.1.1
  - package: dbt-labs/codegen
    version: 0.12.1
  - package: elementary-data/elementary
    version: 0.14.0
Any help is very much appreciated!
e
Hey there @Hossein Jazayeri! What's in your requirements.txt?
h
Here it is:
Copy code
black==22.10.0
dbt-snowflake>=1.7.0,<1.8.0
elementary-data[snowflake]==0.14.0
pre-commit==2.21.0
python-dotenv==0.21.0
sh==1.14.3
sqlfluff-templater-dbt==2.3.5
dbt-metabase==1.1.0
e
Are you seeing anything in your 
edr.log
file? This worked locally for you?
h
I don’t have an edr.log at all 🤔
Yes, it works locally
Actually this is the log content:
Copy code
2024-03-12 07:16:43 — INFO — Running with edr=0.14.0
2024-03-12 07:16:43 — INFO — Installing packages for edr internal dbt package...
2024-03-12 07:16:43 — INFO — Running dbt --log-format json deps --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:16:47 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'deps', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 3451
2024-03-12 07:16:47 — INFO — Running with dbt=1.7.3
2024-03-12 07:16:47 — INFO — Updating lock file in file path: /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project/package-lock.yml
2024-03-12 07:16:47 — INFO — Installing dbt-labs/dbt_utils
2024-03-12 07:16:47 — INFO — Installed from version 0.8.6
2024-03-12 07:16:47 — INFO — Updated version available: 1.1.1
2024-03-12 07:16:47 — INFO — Installing elementary-data/elementary
2024-03-12 07:16:47 — INFO — Installed from version 0.14.0
2024-03-12 07:16:47 — INFO — Updated version available: 0.14.1
2024-03-12 07:16:47 — INFO — 
2024-03-12 07:16:47 — INFO — Updates available for packages: ['dbt-labs/dbt_utils', 'elementary-data/elementary']                 
Update your versions in packages.yml, then run dbt deps
2024-03-12 07:16:47 — DEBUG — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_latest_invocation", "macro_args": {}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:16:59 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_latest_invocation", "macro_args": {}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 1824
2024-03-12 07:16:59 — DEBUG — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_adapter_type_and_unique_id", "macro_args": {}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:17:03 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_adapter_type_and_unique_id", "macro_args": {}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 1498
2024-03-12 07:17:03 — DEBUG — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_elementary_database_and_schema", "macro_args": {}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:17:07 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_elementary_database_and_schema", "macro_args": {}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 1488
2024-03-12 07:17:07 — INFO — Elementary's database and schema: '"DEV_HJAZAYERI.OBSERVABILITY"'
2024-03-12 07:17:07 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_test_results", "macro_args": {"days_back": 7, "invocations_per_test": 720, "disable_passed_test_metrics": false}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:17:29 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_test_results", "macro_args": {"days_back": 7, "invocations_per_test": 720, "disable_passed_test_metrics": false}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 1430
2024-03-12 07:17:29 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_source_freshness_results", "macro_args": {"days_back": 7, "invocations_per_test": 720}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:17:34 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_source_freshness_results", "macro_args": {"days_back": 7, "invocations_per_test": 720}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 1430
2024-03-12 07:17:34 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_models", "macro_args": {"exclude_elementary": true}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:17:40 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_models", "macro_args": {"exclude_elementary": true}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 397914
2024-03-12 07:17:40 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_sources", "macro_args": {}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:17:46 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_sources", "macro_args": {}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 222758
2024-03-12 07:17:46 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_exposures", "macro_args": {}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:17:52 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_exposures", "macro_args": {}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 1430
2024-03-12 07:17:52 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_models_runs", "macro_args": {"days_back": 7, "exclude_elementary": true}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:18:00 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_models_runs", "macro_args": {"days_back": 7, "exclude_elementary": true}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 1430
2024-03-12 07:18:00 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_dbt_models_test_coverage", "macro_args": {}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:18:05 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_dbt_models_test_coverage", "macro_args": {}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 57904
2024-03-12 07:18:05 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_nodes_depends_on_nodes", "macro_args": {"exclude_elementary": true}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:18:11 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_nodes_depends_on_nodes", "macro_args": {"exclude_elementary": true}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 212926
2024-03-12 07:18:11 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_models_latest_invocation", "macro_args": {}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:18:19 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_models_latest_invocation", "macro_args": {}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 77540
2024-03-12 07:18:19 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_models_latest_invocations_data", "macro_args": {}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project
2024-03-12 07:18:25 — DEBUG — Result bytes size for command '['dbt', '--log-format', 'json', 'run-operation', 'elementary.log_macro_results', '--args', '{"macro_name": "elementary_cli.get_models_latest_invocations_data", "macro_args": {}}', '--project-dir', '/usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project']' is 1434
2024-03-12 07:20:56 — INFO — Running with edr=0.14.0
2024-03-12 07:22:38 — INFO — Running with edr=0.14.0
2024-03-12 07:22:58 — INFO — Running with edr=0.14.0
2024-03-12 07:23:20 — INFO — Running with edr=0.14.0
2024-03-12 07:25:47 — INFO — Running with edr=0.14.0
v
heey! I have same issue. works in dev mode, in prod when running on airflow using KubernetesPodOperator get:
Copy code
subprocess.CalledProcessError: Command '['dbt', 'run', '-m', 'elementary_cli.alerts.alerts_v2', '--project-dir', '/usr/local/lib/python3.9/site-packages/elementary/monitor/dbt_project']' died with <Signals.SIGKILL: 9>.
o
hey @Hossein Jazayeri @Valerija Životkevič, looks like your airflow is killing the command, what is the timeout for your tasks?
v
Heey, @Ofek Weiss, I have extended timeout to 20mins, but I get this error when task is running only for 8mins
o
@Hossein Jazayeri looking at the command you run again, the 200 execution limit is pretty massive, so i suspect there might be something related to memory limits on the pod that is created that causes this issue, can you try reducing it (and maybe even days back) and seeing if this helps? @Valerija Životkevič can you share the command that you run and the airflow output that you get?
v
Hi, @Ofek Weiss, I have reduced a number of days back to 1 and it worked for 
edr send-report
( I was getting the same SIGKILL error for both edr send-report and edr monitor). However, this change did not impact 
edr monitor
, even though I have also added a tag to only monitor one model. The command I’m running in a DAG: 
"edr monitor -st {{ var.value.slack_token }} -ch data_anomalies --days-back 1 --filters tags:beyondbody --group-by table"
and airflow output is:
Untitled
o
@Valerija Životkevič from the logs it seems like the pod was killed because there was not enough memory for it (OOMKilled), how much memory is allocated to the pod?, how much memory is there for the node that runs it?
v
Hey, @Ofek Weiss, I changed resource memory limits, and now OOMKilled is not accruing. But the task is still not completed and stuck:
Copy code
*** Reading remote log from <gs://us-central1-kilo-dbt-v2-0-49f1bbc1-bucket/logs/dag_id=monitoring_elementary/run_id=manual__2024-03-25T13:37:21.469578+00:00/task_id=edr_monitor/attempt=1.log>.
[2024-03-25, 13:37:31 UTC] {taskinstance.py:1104} INFO - Dependencies all met for dep_context=non-requeueable deps ti=<TaskInstance: monitoring_elementary.edr_monitor manual__2024-03-25T13:37:21.469578+00:00 [queued]>
[2024-03-25, 13:37:31 UTC] {taskinstance.py:1104} INFO - Dependencies all met for dep_context=requeueable deps ti=<TaskInstance: monitoring_elementary.edr_monitor manual__2024-03-25T13:37:21.469578+00:00 [queued]>
[2024-03-25, 13:37:31 UTC] {taskinstance.py:1309} INFO - Starting attempt 1 of 2
[2024-03-25, 13:37:31 UTC] {taskinstance.py:1328} INFO - Executing <Task(KubernetesPodOperator): edr_monitor> on 2024-03-25 13:37:21.469578+00:00
[2024-03-25, 13:37:31 UTC] {standard_task_runner.py:57} INFO - Started process 1548 to run task
[2024-03-25, 13:37:31 UTC] {standard_task_runner.py:84} INFO - Running: ['airflow', 'tasks', 'run', 'monitoring_elementary', 'edr_monitor', 'manual__2024-03-25T13:37:21.469578+00:00', '--job-id', '5086314', '--raw', '--subdir', 'DAGS_FOLDER/monitoring_elementary.py', '--cfg-path', '/tmp/tmpp6024l2c']
[2024-03-25, 13:37:31 UTC] {standard_task_runner.py:85} INFO - Job 5086314: Subtask edr_monitor
[2024-03-25, 13:37:32 UTC] {task_command.py:414} INFO - Running <TaskInstance: monitoring_elementary.edr_monitor manual__2024-03-25T13:37:21.469578+00:00 [running]> on host airflow-worker-czkqh
[2024-03-25, 13:37:32 UTC] {taskinstance.py:1547} INFO - Exporting env vars: AIRFLOW_CTX_DAG_EMAIL='valerija.zivotkevic@kilo.health' AIRFLOW_CTX_DAG_OWNER='airflow' AIRFLOW_CTX_DAG_ID='monitoring_elementary' AIRFLOW_CTX_TASK_ID='edr_monitor' AIRFLOW_CTX_EXECUTION_DATE='2024-03-25T13:37:21.469578+00:00' AIRFLOW_CTX_TRY_NUMBER='1' AIRFLOW_CTX_DAG_RUN_ID='manual__2024-03-25T13:37:21.469578+00:00'
[2024-03-25, 13:37:32 UTC] {pod.py:926} INFO - Building pod edr-monitor-t1ipm90e with labels: {'dag_id': 'monitoring_elementary', 'task_id': 'edr_monitor', 'run_id': 'manual__2024-03-25T133721.4695780000-98cc236f9', 'kubernetes_pod_operator': 'True', 'try_number': '1'}
[2024-03-25, 13:37:32 UTC] {base.py:73} INFO - Using connection ID 'kubernetes_default' for task execution.
[2024-03-25, 13:37:33 UTC] {pod.py:490} INFO - Found matching pod edr-monitor-t1ipm90e with labels {'airflow_kpo_in_cluster': 'False', 'airflow_version': '2.6.3-composer', 'dag_id': 'monitoring_elementary', 'kubernetes_pod_operator': 'True', 'run_id': 'manual__2024-03-25T133721.4695780000-98cc236f9', 'task_id': 'edr_monitor', 'try_number': '1'}
[2024-03-25, 13:37:33 UTC] {pod.py:491} INFO - `try_number` of task_instance: 1
[2024-03-25, 13:37:33 UTC] {pod.py:492} INFO - `try_number` of pod: 1
[2024-03-25, 13:37:33 UTC] {pod_manager.py:359} WARNING - Pod not yet started: edr-monitor-t1ipm90e
[2024-03-25, 13:37:34 UTC] {pod_manager.py:359} WARNING - Pod not yet started: edr-monitor-t1ipm90e
[2024-03-25, 13:37:35 UTC] {pod_manager.py:359} WARNING - Pod not yet started: edr-monitor-t1ipm90e
[2024-03-25, 13:37:39 UTC] {pod_manager.py:447} INFO - [base]     ________                          __
[2024-03-25, 13:37:39 UTC] {pod_manager.py:447} INFO - [base]    / ____/ /__  ____ ___  ___  ____  / /_____ ________  __
[2024-03-25, 13:37:39 UTC] {pod_manager.py:447} INFO - [base]   / __/ / / _ \/ __ `__ \/ _ \/ __ \/ __/ __ `/ ___/ / / /
[2024-03-25, 13:37:39 UTC] {pod_manager.py:447} INFO - [base]  / /___/ /  __/ / / / / /  __/ / / / /_/ /_/ / /  / /_/ /
[2024-03-25, 13:37:39 UTC] {pod_manager.py:447} INFO - [base] /_____/_/\___/_/ /_/ /_/\___/_/ /_/\__/\__,_/_/   \__, /
[2024-03-25, 13:37:39 UTC] {pod_manager.py:447} INFO - [base]                                                  /____/
2024-03-25T13:37:39.737746822Z 

[2024-03-25, 13:37:39 UTC] {pod_manager.py:447} INFO - [base] Any feedback and suggestions are welcomed! join our community here - <https://bit.ly/slack-elementary>
2024-03-25T13:37:39.845284541Z 

[2024-03-25, 13:37:39 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:39 — INFO — Running with edr=0.14.1
[2024-03-25, 13:37:39 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:39 — INFO — Installing packages for edr internal dbt package...
[2024-03-25, 13:37:45 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:39 — INFO — Running dbt --log-format json deps --project-dir /usr/local/lib/python3.9/site-packages/elementary/monitor/dbt_project
[2024-03-25, 13:37:45 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:45 — INFO — Running with dbt=1.5.10
[2024-03-25, 13:37:45 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:45 — INFO — Installing dbt-labs/dbt_utils
[2024-03-25, 13:37:45 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:45 — INFO — Installed from version 0.8.6
[2024-03-25, 13:37:45 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:45 — INFO — Updated version available: 1.1.1
[2024-03-25, 13:37:45 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:45 — INFO — Installing elementary-data/elementary
[2024-03-25, 13:37:45 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:45 — INFO — Installed from version 0.14.1
[2024-03-25, 13:37:45 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:45 — INFO — Up to date!
[2024-03-25, 13:37:45 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:45 — INFO —
[2024-03-25, 13:37:45 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:37:45 — INFO — Updates available for packages: ['dbt-labs/dbt_utils']
[2024-03-25, 13:38:12 UTC] {pod_manager.py:447} INFO - [base] Update your versions in packages.yml, then run dbt deps
[2024-03-25, 13:38:20 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:38:12 — INFO — edr (0.14.1) and Elementary's dbt package (0.14.1) are compatible.
[2024-03-25, 13:38:20 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:38:20 — INFO — Elementary's database and schema: '"kilo-dw.elementary"'
[2024-03-25, 13:38:20 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:38:20 — INFO — Running internal dbt run to populate alerts
[2024-03-25, 13:38:24 UTC] {pod_manager.py:447} INFO - [base] 2024-03-25 13:38:20 — INFO — Running dbt run -m elementary_cli.alerts.alerts_v2 --project-dir /usr/local/lib/python3.9/site-packages/elementary/monitor/dbt_project
[2024-03-25, 13:38:24 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:24  Running with dbt=1.5.10
[2024-03-25, 13:38:26 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:24  target not specified in profile 'elementary', using 'default'
[2024-03-25, 13:38:26 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:26  Registered adapter: bigquery=1.5.3
[2024-03-25, 13:38:26 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:26  Found 41 models, 6 tests, 0 snapshots, 0 analyses, 1283 macros, 2 operations, 0 seed files, 6 sources, 0 exposures, 0 metrics, 0 groups
[2024-03-25, 13:38:28 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:26
[2024-03-25, 13:38:28 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:28
[2024-03-25, 13:38:28 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:28  Running 1 on-run-start hook
[2024-03-25, 13:38:28 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:28  1 of 1 START hook: elementary.on-run-start.0 ................................... [RUN]
[2024-03-25, 13:38:28 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:28  1 of 1 OK hook: elementary.on-run-start.0 ...................................... [[32mOK[0m in 0.00s]
[2024-03-25, 13:38:28 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:28
[2024-03-25, 13:38:28 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:28  Concurrency: 4 threads (target='default')
[2024-03-25, 13:38:28 UTC] {pod_manager.py:447} INFO - [base] [0m13:38:28
[2024-03-25, 13:43:28 UTC] {pod_manager.py:460} INFO - [base] [0m13:38:28  1 of 1 START sql incremental model elementary.alerts_v2 ........................ [RUN]
[2024-03-25, 13:48:29 UTC] {pod_manager.py:460} INFO - [base] None
[2024-03-25, 13:53:30 UTC] {pod_manager.py:460} INFO - [base] None
[2024-03-25, 13:58:32 UTC] {pod_manager.py:460} INFO - [base] None
[2024-03-25, 14:03:33 UTC] {pod_manager.py:460} INFO - [base] None
[2024-03-25, 14:08:34 UTC] {pod_manager.py:460} INFO - [base] None
[2024-03-25, 14:13:36 UTC] {pod_manager.py:460} INFO - [base] None
[2024-03-25, 14:18:37 UTC] {pod_manager.py:460} INFO - [base] None
[2024-03-25, 14:23:39 UTC] {pod_manager.py:460} INFO - [base] None
[2024-03-25, 14:28:40 UTC] {pod_manager.py:460} INFO - [base] None
[2024-03-25, 14:33:41 UTC] {pod_manager.py:460} INFO - [base] None
[2024-03-25, 14:38:42 UTC] {pod_manager.py:460} INFO - [base] None
[2024-03-25, 14:43:44 UTC] {pod_manager.py:460} INFO - [base] None
@Ofek Weiss I have tried running the same 
edr monitor
command locally in docker with prod image, but same thing happens- getting stuck on building incremental alerts_v2 model with no errors. Maybe something comes to your mind what can be the cause of this issue?
o
@Valerija Životkevič can you share your 
dbt.log
file? (privately is ok if you prefer)
v
Shared privately 🙏
35 Views
Open in Slack
PreviousNext
Powered by