Alex
04/08/2025, 10:28 AM- name: mdWeighIn
config:
elementary:
timestamp_column: "_AIRBYTE_EMITTED_AT"
tests:
- elementary.volume_anomalies:
time_bucket:
period: day
count: 1
detection_period:
period: day
count: 3
training_period:
period: day
count: 15
config:
severity: warn
tags: ['elementary']
The attached screenshot is what gets generated. You can see that the count is all 0 for the Training period. The detection period is also calculating incorrectly for all dates but surprisingly the most recent day (08/04) does record the correct row count.
We double checked by running a quick query ourselves on this table and have confirmed that there are definitely rows generated for each day of _AIRBYTE_EMITTED_AT so we currently don't understand why the test results are giving little to no row counts.
Any help on anything we may have missed would be really appreciated!Noya Offer
04/08/2025, 3:27 PMAlex
04/08/2025, 8:21 PMNoya Offer
04/09/2025, 9:31 AMAlex
04/09/2025, 9:57 AMdata_monitoring_metrics and `metrics_anomaly_score`tables don't match the query given in troubleshooting steps. Screenshot of what columns we have in our diagnostic tables.
e.g
metric_timestamp doesn't exist in data_monitoring_metrics
metric_value, zscore, severity, detected_at doesn't exist in metrics_anomaly_scoreAlex
04/09/2025, 9:59 AMAlso, is there anything in the way this table is built that can cause this? Do you delete rows from it?The table is an incremental model and we do have delete+insert strategy in our config. Is that something that would affect the anomaly detection? This table is currently in my dev database and was simply cloned from prod, so i didn't build the model. All i ran was
dbt test --select tag:elementaryNoya Offer
04/10/2025, 1:01 PMNoya Offer
04/10/2025, 1:07 PMcount(*), I believe there's no time where the table is completely empty (after deleting), right?
Checking the metrics would be very helpful for this