Hey all, I am upgraded our environment to the following:

dbt-core == 1.7.3

dbt-bigquery == 1.7.3

elementary-data == 0.16.1

and my dbt package is with:

- package: elementary-data/elementary

version: 0.16.1

previously we used :

dbt-core == 1.6.1

dbt-bigquery == 1.6.1

elementary-data == 0.14.1

and my dbt package is with:

- package: elementary-data/elementary

version: 0.14.1

when running there is an issue with the

on-run-end

hook, but only when running the specific elementary tests. it took more than an hour what used to run in 20 minutes. anyone has an idea how to decrease it without downgrading the version?

For example see https://elementary-community.slack.com/archives/C02CTC89LAX/p1701710053524279

Hey @Frank Tubbing [Beequip], The issues is not that it upload, the issues is that its taking so long.. The when my

dbt run

job runs, the post hook dosent take long, it only happens after i run the

all_columns_anomalies

where the

test

part takes about 5 minutes and the post hook takes way more than an hour... below is the stdout example:

Elementary: Started running data monitors on: CT.DQ.FEATURES_USAGE_PER_DAY JobSchedulingEditJob_test

Elementary: Finished running data monitors on: CT.DQ.FEATURES_USAGE_PER_DAY all columns

2 of 2 FAIL 1 elementary_all_columns_anomalies_features_usage_per_day_4__average__day__1___usage_date___day_of_week__day__1__usage_date__day__168  [FAIL 1 in 371.59s]

Running 1 on-run-end hook

1 of 1 START hook: elementary.on-run-end.0 ..................................... [RUN]

1 of 1 OK hook: elementary.on-run-end.0 ........................................ [OK in 0.00s]

Finished running 2 tests, 2 hooks in 1 hours 22 minutes and 45.84 seconds (4965.84s).

Completed with 2 errors and 0 warnings:

Failure in test elementary_all_columns_anomalies_cp_and_acv_per_day_4__average__day__1___date___day_of_week__day__1__date__day__84 (models/reporting/marketing/schema.yml)

Got 1 result, configured to fail if != 0

compiled Code at /app/target/f287dc0/compiled/temp/models/reporting/schema.yml/elementary_all_columns_anomali_91f60edf77927b0b4087e0649c8eb14d.sql

Failure in test elementary_all_columns_anomalies_features_usage_per_day_4__average__day__1___usage_date___day_of_week__day__1__usage_date__day__168 (models/reporting/product/schema.yml)

Got 1 result, configured to fail if != 0

compiled Code at /app/target/f287dc0/compiled/temp/models/reporting/schema.yml/elementary_all_columns_anomali_e5e9275b419cdba505ddfd41ac4436dd.sql

Done. PASS=0 WARN=0 ERROR=2 SKIP=0 TOTAL=2