I tried to create a dashboard in superset to monit...
# troubleshoots
square-activity-64562
08/25/2021, 5:18 PMI tried to create a dashboard in superset to monitor what all tags are present in datahub
Copy code
SELECT urn AS urn,
count(*) AS count
FROM
(SELECT urn
from metadata_aspect_v2
where aspect = 'tagKey') AS expr_qry
GROUP BY urn
ORDER BY count DESCsquare-activity-64562
08/25/2021, 5:19 PMBasically I am trying to find out what how many entities have what tag applied
square-activity-64562
08/25/2021, 5:22 PMsomething like
Copy code
tag1 datasets 3
tag1 tasks 1
tag2 datasets 5square-activity-64562
08/25/2021, 5:22 PMBasically trying to get a tag usage overview
m
mammoth-bear-12532
08/25/2021, 6:25 PM
@square-activity-64562: may not be very scalable to hit mysql for this
mammoth-bear-12532
08/25/2021, 6:26 PM
you probably want to use the elastic index for these queries
mammoth-bear-12532
08/25/2021, 6:26 PM
also: it is a bit fragile to run these queries against the raw storage / index layers to get this stuff out
mammoth-bear-12532
08/25/2021, 6:26 PM
since that could change in a future upgrade
mammoth-bear-12532
08/25/2021, 6:27 PM
take a look at how the metadata analytics endpoint is built... and maybe extend it to add these features : we can figure out a generic design together
mammoth-bear-12532
08/25/2021, 6:27 PM
you can still connect superset to it to visualize I guess
mammoth-bear-12532
08/25/2021, 6:27 PM
it would require writing a "datahub source" for superset I guess
3 Views