Hello, in the recent town hall you demo’d dataset ...
# ingestion
s
Hello, in the recent town hall you demo’d dataset stats ingestion from sql databases. The stats included number of rows, percentiles etc. Does your rest API support adding stats for custom datasets?
o
Hi! The aspect related to usage stats is
DatasetUsageStatistics
, ingesting this aspect directly through the API is supported. Current supported sources for profiling through the ingestion scripts can be found here: https://datahubproject.io/docs/metadata-ingestion/source_docs/sql_profiles/#capabilities
s
This feature is grayed out in the server UI. How do you enable it? We are using 0.8.25
o
I'm not sure what you mean, are you trying to add the aspect through the UI? This is not supported, you would have to ingest the aspect: https://datahubproject.io/docs/cli/#put . The section will remain grayed out until the aspect exists on an entity
s
No I see that you can add the metrics with the API. When I look at a dataset in the UI it shows a few columns schema, documentation, properties. It also lists stats which is grayed out so I was wondering if you need to enable it or will it show when I start to write stats ?
o
It should become clickable once the aspect is populated