Hi Datahub team, I am Etsy and we're the customer ...
# advice-metadata-modeling
h
Hi Datahub team, I am Etsy and we're the customer of Datahub. We use it to manage our BigQuery tables. And I was wondering if Datahub provides any API to surface these BQ column stats: • null counts and proportions • distinct counts and proportions • minimum, maximum, mean, median, standard deviation, some quantile values • histograms or frequencies of unique values
👀 1
f
Hi Shihao, We use DH with BQ. We've installed the profiling module and it provides some of the data analysis stats that you want. be warned that the DH data analysis queries on BQ take a lot of slot time so can impact production jobs
thanks bear 1