A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi! I Have some tables in redshift that only are used to backup and it's not desired to show then on datahub. This tables have a "_$old" final. How could i filter them using my ingestion recipe?
PS: This tables existes in all my schemas.

This is my test ingestion recipe:
```source:
  type: redshift
  config:
    # Coordinates
    host_port: *******
    database: *******

    # Credentials
    username: ******
    password: ******

    # Options
    include_tables: True 
    include_table_lineage: True
    include_views: False
    
    # Autorization
    schema_pattern:
      allow:
        - "wine_stg"

    profiling:
      enabled: true
      include_field_null_count: true
      include_field_min_value: true
      include_field_max_value: true
      include_field_mean_value: true
      include_field_median_value: false
      include_field_histogram: false

sink:
  # sink configs
  type: "datahub-rest"
  config:
    server: "******"```


You can use a deny table_pattern with the suffix as mentioned in the doc <https://datahubproject.io/docs/metadata-ingestion/source_docs/redshift/>

```      table_pattern:
            deny:
              - '.*\\\$old\$'```
