Hi! I am working on data profiling for a MSSQL dat...
# troubleshoot
v
Hi! I am working on data profiling for a MSSQL datasource. I can run it locally with
profiling.enabled: True
in my recipe. I can see aspect names
datasetProfile
in the output, along with the values in the respective aspects being produced, in terms of
rowCount
,
columnCount
,
fieldProfiles
, etc. However, when I ingest onto the UI, with sink type set to
datahub-rest
, I don't see the data. The
Stats
and
Validiation
tabs remain disabled, even though i can see the CURL call being made to GMS in the ingestion logs with the with the exact same
datasetProfile
values . Any idea why this might be happening?
b
Hi @victorious-spoon-76468! If you've ingested profiling information for MSSQL, then the Stats table should definitely appear as clickable for those tables which have been profiled. Are you sure that the datasetProfile workunits you saw being ingested correspond to this urn?
v
Update: tried profiling for Redshift and the example provided here https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/examples/mce_files/demo-profiles.json . Same results. The API call to ingest datasetProfile returns success, but the Stats table is unclickable. Currently using DataHub version
0.8.41
on AWS EKS