Hi, We use Great Expectations (GE) for data assert...
# ui
m
Hi, We use Great Expectations (GE) for data assertion quality tests, but we have other engines for other types of data quality tests. I would like to use the datahub validation UI tab for the other engines as well and not only limit it to GE. Is there anyone who has done this and can shed some light on it? Looks like the current validation tab is very adjusted to GE integrations. Datahub product mangers @little-megabyte-1074 - Is there any plan to make this validation tab more generic so it can be integrated with other data quality engines?
a
Have you checked out this example for sending generic data quality results to datahub? https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/examples/library/data_quality_mcpw_rest.py There are some limitations (and it's poorly documented..), but with some work you can get almost any tool or even just custom code to work with the validation tab
l
Hi @modern-traffic-72108! +1 to what Mikko posted above We don’t have additional data-quality related work on our near-term roadmap, but I’d be curious to hear feedback about what’s currently missing so we can consider it in future planning cycles!
m
Thanks! @ambitious-piano-33685 I wasn't aware of it. It is indeed poorly documented, but I will look into it. As we progress @little-megabyte-1074 I will keep you posted.
s
@miniature-eve-21984 Relevant to one of my Qs from yesterday