Hi team, I'm using profiler configuration in my ingestion properties for BQ. But I can't find any anything under STATS for any of my tables. Can someone please help. @gray-shoe-75895

Have you checked the ingestion logs?? If so, does it say that the tables have been profiled??

'entities_profiled': '0',

it is showing this for all the datasets

I think you should tweak or disable the following config parameters:

profiling.profile_if_updated_since_days

-> Profile table only if it has been updated since these many number of days. If set to

null

, no constraint of last modified time for tables to profile. Supported only in

snowflake

,

snowflake-beta

and

BigQuery

.

profiling.profile_table_size_limit

-> Profile tables only if their size is less then specified GBs. If set to

null

, no limit on the size of tables to profile. Supported only in

snowflake-beta

and

BigQuery

profiling.profile_table_row_limit

-> Profile tables only if their row count is less then specified count. If set to

null

, no limit on the row count of tables to profile. Supported only in

snowflake-beta

and

BigQuery

okay let me try it

@polite-application-51650 Hi, let me know if you manage to solve this. I am facing the same issue with MSSQL. No error or anything, profiling config just does not seem to be picked up

@future-hair-23690 yes the stats are now coming up after I gave the extra configs as suggested by Tamas.

Hmmm, alrighty. I did add those as well with no luck. Will try to plug everything in and see 🙂 thanks