Seems like the table_pattern is broken when ingest...
# troubleshoot
c
Seems like the table_pattern is broken when ingesting Snowflake metadata. With a recipe like:
Copy code
source:
  type: "snowflake"
  config:
    username: ...
    password: ...
    host_port: ...
    database_pattern:
      ignoreCase: true
      allow:
        - "database"
    schema_pattern:
      ignoreCase: true
      allow:
        - "schema"
    table_pattern:
      ignoreCase: true
      deny:
        - ".*"
The tables from database.schema are still getting ingested. Same thing if using
database.*
or
database.schema.*
as table_pattern.deny... Or I am missing something?
l
@helpful-optician-78938 can you take a look? ^
h
I'll look into this soon.
c
@helpful-optician-78938 have you had a chance to look at this? I am trying to ingest & profile a single table from Snowflake but can't get the patterns to work.
w
@curved-sandwich-81699 can you verify if what you’re trying to ingest is a table or a view? You can do that by changing the
include_tables
and
include_views
values in your config. Based on that, try to set the appropriate pattern. My hunch is that you’re trying to apply the table_pattern filter to a view. Try the view_pattern instead with the syntax
database.schema.table
c
@witty-state-99511 I did forgot to add a
view_pattern
and that fixes everything... Thank you!
w
Awesome!