Hi team, short question on dataset statistics. Can I access them via a GraphAPI querywhen they have been created? Idea is to programatically get infos about dataset statistcs (last update, number of NaNs...). Additionally, is there a concise way of reporting the number of datasets with statistics attached? Thank you for insights!

Hi @clean-crayon-15379, Seems like we do have a graphQL api for dataset. Checkout the fields "datasetProfile" (which has field profiles) and "usageStats" (for usage related statistics)

Thank you, @miniature-tiger-96062 I saw this one, but was thinking about the column statistics when we run the profiling during ingestion. As far as I could see, datasets with statistics still maintain the null in usageStats, will check again after my extensive profiling went through tomorrow.

We do have DatasetFieldProfile object that give info about stats about each column of a dataset. https://datahubproject.io/docs/graphql/objects#datasetfieldprofile Is this not what you are looking for?

Hi @miniature-tiger-96062, that's exactly what I was looking for, thank you very much!