hi team when i set up `exposure schema validity` it always p Elementary Community #community-support

hi team, when i set up `exposure_schema_validity` ...

michael böhm

11/30/2023, 4:36 PM

hi team, when i set up

exposure_schema_validity

it always passes, no matter what (fantasy) `column_name`s are listed under `meta`/`referenced_columns`.

Copy code

dbt-core 1.7.1, dbt-databricks 1.7.1, elementary-data 0.12.0, elementary(package) 0.12.2

michael böhm

11/30/2023, 4:36 PM

exposure.yml:

Copy code

- name: installs__explore
  type: dashboard
  maturity: low
  url: <…>
  description: <…>
  depends_on:
    - ref('fct_installs')
  owner:
    name: <…>
    email: <…>
  meta:
    referenced_columns:
      - column_name: country_code
      - column_name: installed_date
      - column_name: opened_date
      - column_name: os_version

model.yml

Copy code

- name: fct_installs
  description: <…>
  tests:
    - elementary.exposure_schema_validity
  columns:
    - <…>

michael böhm

11/30/2023, 4:37 PM

i also tried to put the

column_name

in single or double quotes, to no avail

michael böhm

12/01/2023, 7:52 AM

shameless ping to @Idan Shavit

michael böhm

12/04/2023, 10:53 AM

another shameless ping to recently active @Noa Kurman

Erik Zaadi

12/04/2023, 12:25 PM

Heya @michael böhm! Could you try explicitly adding the

node

property as well with the relevant ref?

Copy code

... 
  meta:
    referenced_columns:
      - column_name: 'country_code'
        node: ref('fct_installs')

Noa Kurman

12/04/2023, 12:30 PM

(when you ping two people from the team we like to surprise you with a third one!)

🎉 1

michael böhm

12/04/2023, 1:31 PM

still passing everything, Erik 😢 thanks for getting back and suggesting, tho. next?

michael böhm

12/04/2023, 2:02 PM

i’m trying to find the sql command (out of the many that a single such test fires on databricks) that represents the test. is it this?

Copy code

select
  count(*) as failures,
  count(*) != 0 as should_warn,
  count(*) != 0 as should_error
from (
  with nothing as (select 1 as num)
  select * from nothing where num = 2
  ) dbt_internal_test

Erik Zaadi

12/04/2023, 3:00 PM

could you add a tag on that test and execute only that? might help isolate the issue a bit

michael böhm

12/04/2023, 3:06 PM

i was executing by name, therefore never running more than this one test. just tried via tag, but same execution. (when i said ‘many sql firing’ i meant the commands for the test and the hooks, not from additional tests)

michael böhm

12/07/2023, 8:07 AM

reminder ping (if there is still hope)

Erik Zaadi

12/07/2023, 8:11 AM

There is always hope! (and thanks for the ping) I'll dm you some times for a huddle

🙇 1

31 Views

Open in Slack

Previous Next