A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

image.png

Hi Guys! Im trying out this tool, I have my resources on AWS.
&gt; While trying to ingest data from Athena, it doesnt find any table, I have double checked all the information and they are correct, can someonie help me with this?

Hi <@U02MKAABKRQ>,
Taking a look at it now and will respond back.

Have you tried adding also the `table_pattern.allow` parameter?
I recall we have some problems with the combination of parameters for profiling

Have I used it correctly? Still nothing returns

<@U02MKAABKRQ> I am trying to run ingestion on our internal athena instance to better see what could be going wrong.

Hi <@U02BJKT2QNN>,
I haven't tried it out myself but have you tried specifying in this format -
```table_pattern:
      allow:
      - "test.*"```

It ended up working for us with a patter similar to that yes. I ws trying to give advice to Wesley

<@U02AYK6RSPP> <@U02BJKT2QNN> my problem might be related to Lake Formation permissions to the IAM User I am using at AWS CLI, we are using Lake Formation at our Data Lake to restrict Glue Catalog permissions to different roles/users
I will check it out and return a answer here

Confirming that it was an AWS Lake Formation issue, a user with correct permissions on Lake Formation can perform cli commands and ingest data from DataHub by Athena correctly!

Thanks a lot <@U02MKAABKRQ>! Good knowledge for us as well.

Thanks, this might be useful for us in the future