Hello All, Issue : not able to ingest a single ta...
# ingestion
e
Hello All, Issue : not able to ingest a single table from a athena Database I was trying to ingest Athena tables with "AwsDataCatalog" as Data Source I have a database named "employees_db" and under that I have 2 tabeles "male_emp" and "female_emp". When I try to ingest the entire "employees_db" , the db and the 2 tables are fuly getting ingested, but the issue arises when I try to ingest a single table from the db.Please help me out in ingesting a specific table in a database with athena source Reciepe file I used: source: config: aws_region: us-east-2 database: employees_db query_result_location: 'S3 location' work_group: primary table_pattern: allow: - male_emp type: athena
1
g
try using
.*male_emp.*
as the allow rule
e
Thank you Harshal, this worked. But can you please help me out, why male_emp didn't work but .male_emp. worked properly
g
The rules are regex expressions, so you need the
.*
to allow stuff at the beginning / end