@Irakli
As I use dbt with Athena in my company, I waiting for the Athena integration feature and sometimes checked the Slack channel, then finally found it. I’m now replacing redash with lightdash, but it doesn’t have enough features, so sent several PRs. I picked up PRs of high priority and critical issues for me, maybe all the Athena users.
•
feat: introduce parameter labels
◦ The most important feature, which is not related to Athena, is the labeled parameter. This is very useful feature of redash because you don’t have to remember actual IDs to filter data with it.
•
perf(athena): use ListTableMetadataCommand instead of GetTableMetadataCommand
◦ It causes an N+1 problem by GetTableMetadataCommand if you have hundreds of tables, the Athena integration doesn’t work by rate limit.
•
feat(athena): allow multiple Athena databases in a single project
◦ Using multiple databases based on the dbt layers is very common in dbt with Athena. Without this feature, we need to have multiple projects to handle a single dbt project.
I’m happy to discuss the approaches to tackle the issues above.