Hi all. We are just implementing a DQ framework in our DBT pipelines and just found Elementary. Looks an amazing project. Quick question product feature question.. Can we take the results of the Elementary tests and use them to update our models by 'tagging' the data it's testing, e.g. with a DQ flag indicating the row fails a DQ test? Reason for asking is we are trying to implement the write audit publish (WAP) pattern where we inspect the raw data and publish it as source tables into a tested 'silver' layer . We are using Databricks. Ideally we'd want to mark rows (each row is an event in the raw data) that fail a DQ check so consumers can decide on whether to use the data. Elementary seems to have the types of tests we want to run and great reports but can it be used to 'tag' the data it's testing?

Hi @Rob Stanton👋 Thanks for the kind words 🤗 If I understand correctly I think you can use the Elementary test results tables for this. Specifically, The alerts tables Elementary adds to your DWH contain a column called

alert_results_query

, running that will return the specific rows that failed the test. Do you think that could work for you? Feel free to elaborate further as well if you like.