Hey <!channel> blob wave We are excited to welcome all the new members 🍌 It would help us a lot if you ⭐* star the project* ⭐ on Github G A new version of Elementary is out (CLI 0.13.2, dbt package 0.13.0) 🎉 ❗_Quick reminder here to upgrade by running

dbt deps

and then `dbt run -s elementary`_ ❗ drop corrupt happy New features drop corrupt happy • ✨ UI/UX improvements ✨ (see video 📽️👇) ◦ New layout and side menu for navigation 🗺️ ◦ Lineage view now includes the folders tree, for easier access to specific tables and exposures 📁 ◦ Navigation buttons from test results to the filtered lineage or test runs 🏃 • aws athena AWS Athena support aws athena ◦ A new Elementary adapter is now available! ◦ This is an amazing contribution made by @Artem Garmash 😍 and with significant help of @Nicola Corda 🤩 (dbt-athena maintainer). • Source freshness results in report 🥬 ◦ You can checkout the design here 🎨. ◦ Collecting source freshness results is currently available for dbt core users. dbt cloud users can checkout this suggestion from @Moss Pauly. • Exclude specific metrics from anomaly detection ⏬ ◦ A new available config to anomaly detection tests, inspired by @Moss Pauly. ◦ This should allow you to exclude known anomalies that you don't intend to fix, or timeframes with data you want excluded from the training set. Read the docs here. drop shocked Other Changes & Bug Fixes drop sad • Added timeout param for uploading to GCS - Thank you @Dmitrii Khriashchikov for surfacing! • Added region name support for Boto3 - Thank you Nell Boulle for contributing 🤩 • Collect Databricks

http_path

- Thank you @Hen Ben-Hemo for surfacing! • Performance optimization for table anomalies queries - Thank you @pei0804 for surfacing! • Fixed failure to get owner for alerts - Thank you @Belle de Veer for fixing 🤩 • Fixed alert filters not working with dbt project dir param - Thank you @Ajay for reporting! • Fixed false anomalies in freshness and volume when table is new - Thank you @Macklin Fluehr for reporting! • Fixed alert table fields type issue - Thank you @Renee Cooper and @Rodrigo Naspleda for reporting! drop joy Updates drop happy • Andreas Kretz made this excellent video tutorial - 📺 • We revamped the docs site, you will now find different tabs for Elementary tests, Cloud and OSS 📖 https://www.loom.com/share/85011f94c7d549a4b32f6651b2a53477?sid=4a8dde08-52ec-412c-b34d-9b21b0e6df61

Hey @Maayan Salom Congratulations to you and your team on the release of this new version. Just wanted to know how anomaly_exclude_metrics is different from the where_expression which can also be used to filter data out.

Hey @Vaibhav Sharma, great question! The difference is: •

where_expression

filters the data itself •

anomaly_exclude_metrics

filters the monitored metrics For example: In a column anomalies test that tests

max_length

on a column

user_id

, you can use

where expression: user_name != 'test'

to filter irrelevant data. If on some day you had and issue and got really long IDs, but this will not be fixed and you just want to exclude it from the anomaly detection graph and test, use

anomaly_exclude_metrics

@Maayan Salom You mean where_expression filters training data before it is fed to the training pipeline, while the exclude option filters out anomalous data points from the resulting data?

Thanks @Maayan Salom & Team for implementing and sharing this. Just a quick note, would it be possible to view the project name where the report is generated like earlier ?

@Vaibhav Sharma Yes, exactly!

I mean in the new UI, the project name is not visible anymore as it used to be on the dashboard section

Ahh got it, it's on the top right no?

top left 🙂

No I mean you have the project name in the top right now, with the DWH logo

aah, it's not showing me 🙈

Got it, you are right. Will check with the team

Cool

Thank you for your work! I want to ask about source freshness results in report. I have run

dbt source freshness

but still don't see the freshness results in the report. The table

dbt_source_freshness_results

is also empty. When command

dbt source freshness

is executing I don't even see the on-run-start hook. What I do wrong?

very exciting update 🎉

Love the new UI!