Hey team, I have an ingestion recipe where I specify a

table_pattern.allow

. I notice that when I enable profiling, it seems to ignore this and profile all of the tables. Do I need to also set

profile_pattern.allow

to the same list? I had assumed it would only profile tables I had allowed with the table allow pattern but maybe I'm wrong there

@helpful-optician-78938 do you know the answer to this?

Hi @brief-wolf-70822, profile_pattern.allow is independent of table_pattern.allow. So, you need to set profile_pattern.allow/deny as well.

Gotcha, thanks all

actually, I'll like to check the rationale of having separate table_pattern and profile_pattern .allow, because if the table_pattern is set to deny a specific table, then why would a person want to ingest the profile of that table?

Hi @better-orange-49102, I think having separate table and profile patterns allows for narrowing down the tables to profile which is a more expensive operation. However, I feel that profile pattern should be applied on top of the table pattern filters.