Trying to use Glue to ingest metadata. What are th...
# ingestionh
handsome-football-66174
08/12/2021, 9:06 PMTrying to use Glue to ingest metadata. What are the configuration options present for Glue (for the .yml file ) to connect?
c
chilly-holiday-80781
08/12/2021, 9:08 PMHi @handsome-football-66174! You can find them here: https://datahubproject.io/docs/metadata-ingestion/source_docs/glue/#config-details
👍 1
h
handsome-football-66174
08/12/2021, 9:26 PMThank you !
handsome-football-66174
08/13/2021, 1:21 PMI am trying to use role_arn , but looks like we are not able to provide anything except the fields mentioned. How do we achieve initially logging in with a user account and then do assume role ?
c
chilly-holiday-80781
08/13/2021, 1:57 PMThe role_arn should be automatically extracted via the AWS API
chilly-holiday-80781
08/13/2021, 1:58 PMSo I think your role should be linked to your account beforehand
h
handsome-football-66174
08/13/2021, 2:21 PMI tried running, it is able to connect. But when I specify the following
database_pattern:
allow:
- "covid_19"
table_pattern:
allow:
- "covid.*"
It is still pulling the tables names whose names do not match covid.*
handsome-football-66174
08/13/2021, 2:22 PMAny issues with the regex pattern specified ?