Still the same issue even after running all steps
# community-support
r
Still the same issue even after running all steps
n
Hey @Ram Can you share what is the current state? In the last message on this thread you said that it’s working.
r
Still we have the same issue , now its started failing in our production env after we migrated with column anomalies metrics and updated elementary package with 0.12.1
n
Did you do the same for the production env (run
dbt deps
and
dbt run -s elementary
)?
r
Yes both env
When i have added column_anomalies metrics to all metrics , i guess coz of this issue is happening
Would appreciate when aavailable to have zoom with me
Its clearly a bug in elementary
n
I tried to run this test type and could not reproduce an error. Can you share the log file of your run? Also, please share the test configuration you set 🙏🏼
r
We run elementary in kubernetes pod ,it was all running fine until i have started column_anomalies metrics then it started failing in dev , Support team asked me to upgrade to 0.12.1 and ran dbt deps and dbt run --select elementary .. Then too its failing for send-report alone .. I tried migrating to prod and there it was running fine until i ran column_anomalies metrics it started failing I am unable to get log file as it runs withiin pod and gets deleted once the airflow dag is done
When you are available we can zoom and i can show steps we run
i can share the metrics we have to your DM
n
If you run dbt on a different model or tests, is it working?
r
In airflow we run all models in once like dbt test
n
The step of running all models is working, and just the test step is failing, right?
r
Can we zoom
Really need help to fix this long pending issue
@Noy Arie this is hte flow process
I will send you the log privately
n
Thanks! Just looked on the log you sent me. It looks like
edr send-report
is failing. The tests (using
dbt test
) and sending alerts (using
edr monitor
) are working. In the log, I see the failure when trying to run the first macro in the generate report flow (
elementary_cli.get_test_results
). Here is the end of the log file:
Copy code
[2023-11-15, 15:49:40 EST] {subprocess.py:92} INFO - NoneType: None
[2023-11-15, 15:49:41 EST] {subprocess.py:96} INFO - Command exited with return code 1
[2023-11-15, 15:49:41 EST] {taskinstance.py:1909} ERROR - Task failed with exception
Traceback (most recent call last):
  File "/mnt/working-dir/avalara_ds/airflow/operators/dbt_bash.py", line 97, in execute
    super().execute(context)
  File "/home/airflow/.local/lib/python3.8/site-packages/airflow/operators/bash.py", line 194, in execute
    raise AirflowException(
airflow.exceptions.AirflowException: Bash command failed. The command returned a non-zero exit code 1.
I found this online: https://github.com/greatexpectationslabs/ge_tutorials/issues/20 Do you have
dbt_project.yml
as mentioned in this link? Can you make sure you have
config-version: 2
?
r
its already 2 as belwo screenshot dbt-project.yml
Point is it was working fine all days until i have started implementing column-anomalies
If i have to see without column-anomalies it will run fine , should i just remove the metrics and then run dbt run -s elementary ? so all previous rows be deleted ??
n
You can try. but from what you sent me (the photo) it looks like
dbt test
and
edr monitor
passed. If something is wrong with this test,
dbt test
should have failed.
r
Its only failing at send-report
Until 10/26 it was running fine all task but then send-report started failing after the metrics
Column-anomalies dbt test is fine and running success
but edr send-report its failing
@Noy Arie i have sent the log detailed to your DM
I also posted in github issues last week https://github.com/elementary-data/elementary/issues/1269
Any one available from support ?
@Geoffrey Stoel @Itamar Hartstein Here is my issue