Does any one have experience of frameworks for defining business logic rule checks for data governance purposes? I’m thinking of things like “a purchase’s

city

field should be one of the cities in this dynamic list of cities” or “the

state

field of a delivery should be X or Y within 7 days of the last update”.

This is basically the field of "data quality"

We’ve not had good experiences with GE (at scale), but maybe it’s worth another look. I also see deequ popping up in the same context a lot. They can probably all do simple null-checks, but I wondering if anyone has tried to apply these tools to more complicated business rule type of checks?

this may sound simplistic, I’d just use an ORM (choose any like SQLAlchemy or ActiveRecord) and write simple tests that encompass those use cases

Hi, both Great Expectations and dbt-tests can easily handle those test-cases and even more, I would advise to take another look on GE