Hi, I found "Queries" tab in the dataset UI. How can I add sample queries? I looked over the documentation, but can't find useful resources for that.

Hey Park- you can find documentation for it here! https://datahubproject.io/docs/metadata-ingestion/#google-bigquery-usage-stats-bigquery-usage

Thanks Gabe Lyons. I am looking the link you provided. Does it support bigquery and snowflake only?

For now, usage stats only support bigquery and snowflake.

We are using presto backed by hive using HMS (or hive query directly ). Guess many companies that uses AWS work w/ Athena, Presto, Hive Presto has audit plugin and hive can be intergated w/ Ranger for query audit.

Got it- we just onboarded snowflake and bigquery first 🙂 but we would love to get usage stats for more sources

I am not sure but I might work for contribute Presto usage stats in my free time if possible. Since more than 500+ users in our company using presto as the main query engine, so it's really useful if presto is supported. I believe that finding other user's query usage pattern for a table is critical feature of data catalog system. because it accelerate data usage for all users.

Absolutely- I completely agree. What sort of timeline would you want the presto usage stats connector in by?

Best to implement by 2021-Q3, but even 2021-Q4 would be great.

^ That will be awesome!!!

@dazzling-judge-80093: ^^ 🙂

I can help as well even though I have limited free time too. We use Starburst Presto where there is the option to have a separate db for the audit logs. I think integrating with that should be fairly easy but that unfortunately won’t work for the non Starburst Presto -> https://docs.starburst.io/354-e/security/event-logger.html https://docs.starburst.io/354-e/security/event-logger.html#completed-queries It even collects the tables from the queries and mark them if the query reads or writes to it -> https://docs.starburst.io/354-e/security/event-logger.html#query-tables

Awesome. will take a look it too and ask help! 🙂

it would be nice if Oracle, mySql usage stats can be onboarded as well