@kapa.ai Given a table with columns:

activity_id

,

activity_timestamp

,

activity_source

,

activity_type

,

activity_metric_1

,

activity_metric_2

I want to have a test which checks this table daily for row counts, and identifies if there is a drop off or complete absence for a

activity_source

, given that different sources will have different usual volumes.

@kapa.ai elementary_report.html it generated is 70mb, when serving with nginx it lags quiet a lot, any advice?

@kapa.ai does disable_dbt_columns_autoupload var work in 0.24

@kapa.ai, what are some patterns to be able a dbt project that uses the dbt elementary package + elementary

edr

CLI tools already to dbt fusion?

@kapa.ai Is anyone using elementary in many projects that are hosted in one github repo? I'm tired of manually going through and incrementing elementary versions at different times and then having to manage different scripts and jobs and environments to make sure i'm running the correct version of the cli to match. I would like to have that version number or package/packages all handled in a shared file or variable or something referenced by the projects that I would like elementary running in. I would obviously have to handle the profiles and schema names and all that in the projects themselves. I could then manage the version in one place and then just make sure the models are being "built" on every run of the separate dbt jobs for each project in case the version does go up or something.

@kapa.ai We have a dbt monorepo where we have many individual DBT projects that are all imported into one main project. Each sub-project is executed on it's own schedule and runs it's own tests. We want to avoid having a dashboard per subproject, but I am unsure how to organize one "main" report effectively with many sub-projects. What are some recommended approaches?

We started using volume anomaly detection with a

timestamp_column

and we notice that the queries generated by the test filter far far further back than the training period. how can we limit that? we have some large tables and want to make it as efficient as possible Ideally since the tables are partitioned by the timestamp column we want to only filter on the duration of the test+detection

@kapa.ai we started getting {} as values for dbt_run_results in execute and compile timestamp columns?

@kapa.ai is it possible to alert a single failed test to both slack and teams?

@kapa.ai A test that triggered a warning yesterday was correctly routed via the Alert Rules I set to Slack, but when it evaluated again as a warning again today it was not routed to Slack. Is this expected?

@kapa.ai I recently upgrade to dbt core 1.12 in bigquery and this error appeared: "Transaction is aborted due to concurrent update against table"

@kapa.ai 1. Is

slack_group_alerts_by

in

+meta

correct, and does it cover model alerts?

On elementary dbt package 0.25.1 with edr 0.25.1 on BigQuery, we set

+meta: {slack_group_alerts_by: table}

in

dbt_project.yml

under both

models:

and

data_tests:

. Manifest confirms 1431/1431 models and 557/557 tests carry it. Two docs pages disagree: the OSS alerts-configuration page names

slack_group_alerts_by

in YAML meta and says it applies to model and test alerts; another says the key is

group_alerts_by

, lives in edr's

config.yml

, and supports test alerts only. Which is correct for 0.25.1, and does grouping apply to model run failures?

@kapa.ai We are planning to implement Elementary in our dbt core/dagster/snowflake stack and I am looking for advised strategies to keep the associated runtime duration minimized.

@kapa.ai We're setting up elementary volume anomalies test a dbt model and the test runs inside an hourly-scheduled Airflow DAG, but each DAG run takes ~2 hours, so effectively we run the test ~12 times per day. We are not setting timestamp column, this is an incremental model . I'd liek to know

@kapa.ai Can I add owners and subscribers to dbt exposures and have alerts sent to business stakeholders?

@kapa.ai We've recently started experimenting with

dbt state

(State adapter: dbt-state v2.29.3 is enabled) while running

dbt core 1.12

Elementary 0.25

and

edr cli 0.25.0

After implementing

dbt state

we've experience problems with alerts not being sent. When the alerts_v2 tables is dropped and we run

edr monitor

it will send the alerts, but will fail to sent alerts the following run. Can you suggest a solution?

@kapa.ai Can you confirm whether Elementary OSS with dbt Core + Airflow supports filtering/grouping the dashboard or lineage by

job_name

, so we can manage each tenant/game through job-based filters?

@kapa.ai We are running edr report and using the argument --days-back of 5 but the command runs for about 40 minutes before maxing out the memory on my dagster instance. I am using elementary 0.25.1. Is this expected behaviour? Is there anything else I can do to speed up the runs?

@kapa.ai what's

test_type

value in

elementary_test_results

table for Volume test? (Elementary volume anomalies tests)

@kapa.ai What's the syntax for table level 25 hour alert

@kapa.ai We are running Elementary in a containerized environment where outbound internet access is intentionally disabled. We noticed that Elementary is attempting to connect to PostHog:

HTTPSConnectionPool(host='<http://app.posthog.com|app.posthog.com>', port=443): Max retries exceeded with url: /batch/

This results in multiple retries and delays:

Backing off send_request(...)

Giving up send_request(...) after 4 tries

We would like Elementary to operate completely offline, without attempting any external network connections or telemetry. Could you please let us know: 1. Is there a supported configuration/environment variable to completely disable PostHog/telemetry? 2. If so, what is the recommended configuration for Elementary CLI 0.25.0? 3. Does disabling telemetry have any impact on Elementary's core functionality or dbt operations? 4. Is there any other outbound network communication that Elementary 0.25.0 may attempt, so that we can ensure the container remains fully offline? We are also seeing this warning:

You are using incompatible versions between edr (0.25.0) and Elementary's dbt package (0.19.0).

Could you also confirm which Elementary dbt package version is recommended/compatible with

edr==0.25.0

? Our requirement is that the container must not make any outbound internet connections, so we would appreciate the recommended configuration for a fully offline/restricted environment. Thanks!

@kapa.ai Is there a supported way to run

edr monitor

without sending the alerts directly, but instead get the generated alerts in a structured format (e.g. JSON) so that our wrapper could pick them up and send them through our gateway?

@kapa.ai what is love Baby don't hurt me Don't hurt me No more

@kapa.ai what are the dbt dependencies of the 0.26.0 version? if i choose the elementary[databricks] version, does it pull the dbt-databricks as dependecy?

@kapa.ai elementary support dbt v2 or not?

@kapa.ai can i have multiple elementary targets/locations in a single dbt project?

@kapa.ai

edr report

getting OOM-killed, looking for ways to reduce its memory footprint We run

edr report

(edr

0.26.0

, dbt package

0.26.0

, Snowflake) inside a container (AWS ECS Fargate). On one of our larger projects the report generation gets OOM-killed — the process exits with

Killed

(SIGKILL) and we see

resource_tracker: ... leaked semaphore objects

at shutdown, right after it loads test results. From the logs, the underlying macro call is:

elementary_cli.get_test_results
days_back: 7, invocations_per_test: 720,
disable_passed_test_metrics: false, skip_test_result_rows: false

We invoke it simply as:

edr report --profiles-dir ... --target-path ... --file-path ...

We understand we can throw more memory at it, but we'd like to reduce what the report loads into memory too. Questions: 1. Are there

edr report

CLI flags (or config) to control

invocations_per_test

,

days_back

,

disable_passed_test_metrics

, and

skip_test_result_rows

?

720

invocations/test seems high — is that the default, and can it be lowered? 2. What's the recommended memory for

edr report

on larger projects? 3. Any guidance on generating the report with a lower memory footprint (pagination/streaming, splitting the window, etc.)? Thanks a lot — happy to share more logs or config if helpful! 🙏

@kapa.ai We recently upgraded our Elementary dbt package to Elementary 0.26.0 but upload time grew from ~6.2m to ~8.1m. We're use dbt v1.12 and BigQuery. Any reason for this? Is it regression or some new behaviour?

@kapa.ai I need to implement a anomaly detection to track the volume of information that recipe per day, in case that this the number drop raise a alert for that.

@kapa.ai Can you write a sample anomaly test based on 2 dimensions ( country and date)