Trying to use Glue to ingest metadata. it is able ...
# ingestion
h
Trying to use Glue to ingest metadata. it is able to connect and ingest . But when I specify the following database_pattern:    allow:     - "covid_19"   table_pattern:    allow:     - "covid.*" It is still pulling the tables names whose names do not match covid.*
w
Hi, that’s interesting. Can you share the entire recipe file content?
l
Can you please try
table_pattern.allow
w
Hi Keerthi, do let us know if Swaroop’s suggestion worked. We’re also looking into it and will update you shortly.
h
@witty-state-99511 @loud-island-88694 Recipe file I am using
Copy code
source:
  type: "glue"
  config:
    aws_region: "us-east-1"
    env: "DEV"

    # Filtering patterns for databases and tables to scan
    database_pattern:
      allow:
      - "covid_19"
    table_pattern:
      allow:
      - "world.*"

sink:
  type: "datahub-rest"
  config:
    server: "<http://localhost:8080>"
w
Hey Keerthi, we see that it’s an issue our end and are working on a fix.
h
Ok, Sounds good.