A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Is there any pattern to follow as I have access to only one schema in the database

<@U02AF6KP4N6> are you following the examples here? <https://datahubproject.io/docs/metadata-ingestion|https://datahubproject.io/docs/metadata-ingestion>
source:
  type: snowflake
  config:
    username: user
    password: pass
    host_port: account_name
    database_pattern:
      # The escaping of the \$ symbol helps us skip the environment variable substitution.
      allow:
    ◦ ^MY_DEMO_DATA.*
    ◦ ^ANOTHER_DB_REGEX
      deny:
    ◦ ^SNOWFLAKE\$
    ◦ ^SNOWFLAKE_SAMPLE_DATA\$
    warehouse: "COMPUTE_WH" # optional
    role: "sysadmin" # optional
    include_views: True # whether to include views, defaults to True
    # table_pattern/schema_pattern is same as above
    # options is same as above

yes, i used the sample and this worked for trial account

but with the actual snowflake account where I have sysadmin access..this pattern is failing

<@U02AF6KP4N6>: Can you share the exact failure message you are seeing?

Screenshot 2021-08-09 at 12.26.36 PM.png

<@UV0M2EB8Q>, here is my configuration and the error that I am facing. This database has 6 schemas which I want to scan. It is not scanning anything