Hi, I am trying to connect with snowflake with datahub. The default (trial snowflake) is working fine. But when I connect to my project instance, it is not scanning any tables/views in the databases. Am I missing any configuration pattern

do you have a schema called DEVSDD in your production instance? Based on your config, you are setup to only ingest DEVSDD.* tables.

^ The allow patterns for databases and schemas will be selecting for only tables with those regex filters that you’ve set. Are you certain that those exist in your database?

@bland-easter-53873: the ingestion will produce a report at the end of the run. Can you paste that here as well?

@mammoth-bear-12532, i tried changing it, but it isn't making any impact

Hmm… can you share some examples of your table and schema names? Just so we can be sure the filters are alright. I don’t think we’ve seen this profiler bug either – if you could paste the trace that would be great!

@bland-easter-53873 there is a report produced by the ingestion run, that would be useful to see. Can you disable profiling and get that report first?

@mammoth-bear-12532, thanks for responding. The configuration worked only after I added the warehouse as a parameter for connection string and it is now scanning. But the profiling is taking longer. Can I customize the profiling to run on only few tables? Also the snowflake-usage is failing with missing column values

For profiling use the “profile_pattern.allow” config to control which tables you want to scan. https://datahubproject.io/docs/metadata-ingestion/source_docs/sql_profiles/