Hey everyone, I have a question regarding the Great Expectations integration. Does anyone know whether I can search for Datasets that have Validations at all or even Datasets that have failed validations? Thanks in advance !

hey Mike! as of right now I unfortunately don't think there would be an easy way to do this with existing search functionality (someone may correct me if I'm wrong). do you mind if I ask what the reason you want this is just to better understand how others want to use the product?

it is great to have the validation within a single source but I received the requirement to get an overview over up-to-date validations aswell as failed ones. Obviously no data owner will look into the tool every day to check for validations so we need to find ways to inform them. We could build a custom solution but on the long run it would be nice to have like a “management cockpit” so people see the evolution. (maybe this could fit into the analytics part => how many of my data sources are up to date?)

makes total sense and is kind of what I expected. right now we're thinking about ways to surface signals that point to freshness of data and making it easier for users to find fresh/trusted data - assertions being a nice signal there! so I could certainly see having the ability to filter entities by only those that have assertions on them (and one step further, only those that have all passing assertions or one failing etc.). Do you think having a filter like that that you could potentially save and reuse as often as you want would be helpful for your situation?

that filter would definitely be helpful. I think overall some “action related” filters could be great, e.g. show all source that have no Data Owner or no filled description (although this might work already through the search). Also triggers could be helpful =>e.g. inform me via email when my validation job failed

definitely that makes a ton of sense! stay tuned for some new potential changes coming before too long hopefully 🙂