Hiya, I'm trying to set up ingestion for Snowflake...
# troubleshoot
a
Hiya, I'm trying to set up ingestion for Snowflake and I'm facing issues with the recipe around the database_pattern.allow setting. Here's my recipe with all the sensitive info removed. When I run ingestion, I see the error below. "ignoreCase" which is a nested field seems to work, but "allow" which has the same hierarchy throws an error. Any idea what I'm doing wrong here?
Copy code
1 validation error for SnowflakeConfig
database_pattern -> allow
  value is not a valid list (type=type_error.list)
Copy code
source:
  type: "snowflake"
  config:
    # Coordinates
    host_port: "xxxxxx"
    warehouse: "xxxxxxx"

    # Credentials
    username: "username"
    password: "password"
    role: "role"
    
    include_table_lineage: "True"
    database_pattern:
     allow: "database_name"
     ignoreCase: "True"

sink:
  type: "datahub-rest"
  config:
    server: xxxxxx
m
@aloof-london-98698 With "allow" parameter could you try following way -
Copy code
allow:
    - "database"
a
This worked ! Thank you @miniature-tiger-96062
m
@aloof-london-98698: the reason for the difference is that
allow
is a list of patterns. So you need to use the
-
for yaml to detect it as an array being provided
a
Thank you @mammoth-bear-12532. The context really helps. Would it be safe to assume that all yml settings with a "." (indicated as nested settings in the documentation) would follow the same pattern?
m
unfortunately not.. it really depends on the type of the setting (whether it is a primitive or a list). We have generally tried to document that in the notes for the config.
thank you 1