Hi , How to we enable SQL profiling for Glue ? Ref...
# all-things-deployment
h
Hi , How to we enable SQL profiling for Glue ? Referring this https://datahubproject.io/docs/metadata-ingestion/source_docs/sql_profiles
s
glue is a catalog , not DB/storage therefore profiling here is not a relevant case use more specific sources aka athena/redshift etc to enable data profiling
b
@shy-parrot-64120 But isn’t every catalog stored in some sort of DB in any case? And by profiling the DB where the catalog is stored, could you not get an accurate data profile of the catalog in question?
s
Glue is the catalog. AWS stores the metadata. I am not sure what is the underlying DB used by AWS. It just stores the metadata. It may or may not have access to the DB of whose metadata is stored in Glue. As @shy-parrot-64120 said you will need to use the specific sources to enable data profiling.