Hi everyone o/ I've been reading the documentations, and I wanted to make sure if DataHub would support my use case and if I understood its documentation correctly.... Use Case: I need to expose an API with the date of the latest available data on External Tables on Redshift Solution: Create a SQL ingestion to push the latest samples from the tables as datasets, and then use the dataset to extract/query the latest date available Would this be correct?

I sounds like all you're interested in is the "last modified date" of a table? If so, you should be able to extract that directly from the source (Redshfit in this case) through querying or any corresponding metadata API. This is the part where some customization will likely be needed as there's no standard way to get that from all variants of SQL engines.

It's like I expected... Thanks for the quick answer, I will take a closer look to the code and documentation for now

👍 feel free to ping if you encounter any issues. Also which company are you with if you don't mind sharing?

Creditas, a fintech startup from Brazil About us: https://www.creditas.com/en/about-us

Cool. Let us know when you start building a POC and we'd love to add Creditas to the list here: https://github.com/linkedin/datahub#adoption

Just an update, we will not start experimenting or do a POC with DataHub right now. We decided to focus on some urgent deliveries we need to make now and leave this issue to a next project in order to give it the proper treatment. Thanks and stay safe.