I am using elementary with Athena Two questions emerged whil Elementary Community #community-support

I am using elementary with Athena. Two questions e...

Vaisakh Mohan

03/13/2025, 10:19 AM

I am using elementary with Athena. Two questions emerged while I was trying to integrate our dbt solution with elementary. 1. Is there a way to get all the records that failed test cases from elementary tables? In dbt core we have a way to store failed records but they store it per test which is ver hard for a combined view. 2. I ran the following query. The table has 200+ records, but the query gave NULL, NULL as result.

Copy code

SELECT distinct result_rows, 
failed_row_count 
FROM "exmaplecom_fusion_transformed_elementary_euc1_bd"."elementary_test_results";

Edit - Another question - why is this table empty? "exmaplecom_fusion_transformed_elementary_euc1_bd"."test_result_rows". I ran the pipelines with and without setting

Copy code

vars:
  elementary:
    test_sample_row_count: -1

Vaisakh Mohan

03/13/2025, 1:11 PM

The empty test_result_rows was fixed when I added this:

Copy code

flags:
  require_explicit_package_overrides_for_builtin_materializations: false
  source_freshness_run_project_hooks: True

Still I need a solution for getting all the rejected records

Noya Offer

03/13/2025, 1:15 PM

Hey Vaisakh! Elementary stores samples of failed test rows. It stores 5 rows by default, but this can be configured. These rows are stored in

test_results_rows

as a JSON. Happy to see it's working now 🙂 Can you please elaborate on what your'e trying to achieve so I can understand the best solution?

Open in Slack

Previous Next