Hi Guys, Need your help on the below points : 1. ...
# ingestion
b
Hi Guys, Need your help on the below points : 1. Does redshift-usage
<https://datahubproject.io/docs/metadata-ingestion/source_docs/redshift/#mixed>
module also ingests queries usage and stats for external tables that are queried via redshift spectrum (tables present in glue data catalog). 2. UI is not showing the column usage bar Current datahub version is v.0.8.23. Any help would be much appreciated..
d
I think it should if we can parse the query. When did you query this table? By default (if you don’t set a time range) usage is getting usage for the previous day.
b
These external tables are queried on daily basis at our end. yes, i m also aligned we can parse the query logs from stl_query table and populate the usage stats from there for these external tables as well. would love to contribute for the same, if it is not built yet? Can anyone confirm is this feature is available as of now or not..
d
The redshift
mixed
mode does query parsing and using stl_scan as well and it is avaiable. The query parsing should get usage for queries which uses external tables as well
Do you see any query for these tables on the query tab?
If you can send some anonymised sample query then I can validate if the sql parser can parse it.