Ella Katz
10/24/2023, 1:08 PMfail_on_zero - You can now configure your volume anomaly tests to fail if there are exactly 0 new records, in addition to the anomaly detection algorithm. Read more here
◦ detection_delay - If your data loads with an expected delay, you can now delay the detection period. This will prevent false alerts on freshness and volume. Thanks @Francois Forster for raising the issue and making this amazing contribution!
◦ ignore_small_changes - If your data set is very static, and even a small change can cause a false anomaly detection, you can not use percentiles to ignore small changes. Read more about this here
• ✨ New test! ✨ exposure_schema_validity 👓
◦ This test helps making sure your exposures are not broken by any changes in the upstream models and sources! If a column the exposure depends on changes or gets deleted, the test will fail and alert about the change to those who need to know.
• Alerts linked to the report! ⚠️ 🔗 📈
◦ If you are hosting your Elementary report on a server or a bucket, just add --report-url link/to/report to your edr monitor command and each alert will have a link to the results of the test in your hosted report
• Crazy performance improvements ⏱️
◦ You should see the impact in runtimes of -
▪︎ dbt tests hook - Reduced the duration of tests failed row sampling and failed rows count
▪︎ Schema changes test - Code was optimized, significantly improving performance
▪︎ Anomaly detection tests - Metrics backfill process was optimized, also reducing the time it takes them to run
drop corrupt Other Changes and Bug fixes drop corrupt
• We added a new contribution guide for both the dbt package and CLI github pink
• Source Freshness Alerts now contain more accurate details of the dbt source freshness invocation
• Fix quote for temp table name by @Trevor Osborne
• Some code refactors by @kovaacs
• Fixing Dependencies in DbtRunner for Uninstalled Packages by @Arun K C
• Further document custom slack channels by @Javier López Tomás
Don't forget to run dbt deps and then dbt run -s elementary after updating the package version in your dbt project.
_As always - We are looking forward to talk to you here on Slack (#C02CTC89LAX,_ #C03LPJ5EYU9_), and happy to schedule calls._Fred
10/24/2023, 1:17 PMDamian Eralio
10/24/2023, 2:13 PMSindre Grindheim
10/24/2023, 2:18 PMElla Katz
10/24/2023, 2:25 PMJulia Masche
10/25/2023, 6:30 AMIlya Michlin
10/25/2023, 6:33 AM