A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

image.png

Hey, I am using the latest version of Datahub and using the snowflake-beta and dbt recipe. I turned on profiling on the Snowflake recipe. When I go to the combined Snowflake + dbt dataset, it does not show the profiling information. It only shows the profiling information when I go to the standalone table sub type. Is this expected behaviour and is there a way to fix this?

I found the problem. There was a mismatch in urn for Snowflake and dbt. In the Snowflake recipe, by default all the urns are converted to small case, while in my profilles.yml of dbt, I put the Database name in capital case, resulting in a manifest.json file where the database name was also capitalised, resulting in a capitalised database name in the urn of the dbt dataset

There is option to disable converting Snowflake urns to lowercase with:
```convert_urns_to_lowercase: false```

I think it’s more the problem of DBT that has mixed cases depending on the coding style of the developers. My solution is to use a transformer and convert certain platform urns to lower case