https://datahubproject.io logo
Join Slack
Powered by
Hi, is there any possibility to see how often a sp...
# ui
a
Hi, is there any possibility to see how often a specific table is consumed ? Or is it just possible to see if a table is consumed ?
✅ 1
b
consumed as in someone viewed the page?
you can use kibana to view the usage logs, it captures the identity of the viewer, time and entity viewed
a
consumed as someone has used a query to get data from that table
b
I'm a little confused here, you mean you want to know if datahub shows the number of queries fired against the database (I believe this functionality is under dataset usage, only a few sources support this functionality, one of them is snowflake)
a
Ah, then it might be, that BigQuery is not supported yet
thank you
b
you might need to check with @dazzling-judge-80093 if you have any queries
d
@aloof-egg-97140 Bigquery supports usage and lineage as well
I think it is enabled by default, or you can enable it with:
Copy code
include_usage_statistics: true
I think 30 days is the retention for these audit data, so you won’t be able to get queries which happened earlier.
a
Thank you. I think we have an error on our side. Because when I try to include it, it gives me “extra fields permitted” error
extra fields not permitted ofc
d
ahh, is it possible your client is old? We merged the bigquery usage into the bigquery source recently.
previous it was a separate source
I recommend to use the latest client with bigquery as we fixed a bunch of things in it recently
a
Thank you @dazzling-judge-80093. We will look into it 🙂
It worked using the new client. Thanks a lot!
d
awesome 🙂
Open in Slack
PreviousNext
Powered by