Thread
#getting-started
    c

    calm-minister-22324

    2 years ago
    Hi everyone o/ I've been reading the documentations, and I wanted to make sure if DataHub would support my use case and if I understood its documentation correctly.... Use Case: I need to expose an API with the date of the latest available data on External Tables on Redshift Solution: Create a SQL ingestion to push the latest samples from the tables as datasets, and then use the dataset to extract/query the latest date available Would this be correct?
    b

    bumpy-keyboard-50565

    2 years ago
    I sounds like all you're interested in is the "last modified date" of a table? If so, you should be able to extract that directly from the source (Redshfit in this case) through querying or any corresponding metadata API. This is the part where some customization will likely be needed as there's no standard way to get that from all variants of SQL engines.
    c

    calm-minister-22324

    2 years ago
    It's like I expected... Thanks for the quick answer, I will take a closer look to the code and documentation for now
    b

    bumpy-keyboard-50565

    2 years ago
    👍 feel free to ping if you encounter any issues. Also which company are you with if you don't mind sharing?
    c

    calm-minister-22324

    2 years ago
    Creditas, a fintech startup from Brazil About us: https://www.creditas.com/en/about-us
    b

    bumpy-keyboard-50565

    2 years ago
    Cool. Let us know when you start building a POC and we'd love to add Creditas to the list here: https://github.com/linkedin/datahub#adoption
    c

    calm-minister-22324

    2 years ago
    Just an update, we will not start experimenting or do a POC with DataHub right now. We decided to focus on some urgent deliveries we need to make now and leave this issue to a next project in order to give it the proper treatment. Thanks and stay safe.