Hi team, I am working with an organization that is using DataHub and Athena. They want to use both together, so they are asking; does Athena integrate with DataHub? Specifically, are the following supported: • Column lineage • Query history • Data sampling

Datahub Integrates with Athena but Column Lineage, and Query History are not supported yet. Data Sampling can be achieved with profiling.

Thanks Tamas. Is there column level lineage coming in the roadmap?

We need to do some investigation on how to get query history, but if we can get it, I think it will be easy to add.

Is there a dependency on Query History for column level lineage to be supported?

Athena doesn't provide this information out of the box, so the only way we can get through parsing sql queries from audit history if it is possible to get from Athena. This is not yet implemented.

Thanks @dazzling-judge-80093. Just at a high level, what would be the expected timeline for releasing these two features for DataHub?

It seems like Athena provides query history so it shouldn’t be hard to implement it, it is just a matter of prioritization on our side -> https://docs.aws.amazon.com/athena/latest/ug/querying.html#queries-viewing-history