Hi Folks! Hope everyone had a restful weekend sleepinggoat 🆕 v0.8.24 is now available! — highlights include: • Adding support for nested Glue schemas • Adding Data Lake Files ingestion source to support data profiling for local files and files stored in AWS S3; supported file types are CSV, TSV, Parquet, and JSON • Improvements to readability in UI to format large numbers, including: adding thousands separators & rounding large numbers to millions with raw value available via tooltip 🎉 Shoutout to our first-time contributors!! @Jiwei0 @senni0418 @lhvubtqn @ShubhamThakre teamwork View the full commit log here 👀

helm update soon? https://github.com/acryldata/datahub-helm excited

Have a question - what would be the difference between data lake ingestions on s3 files vs getting this from Glue?

We have an ongoing incident with 0.8.24. Will be publishing helm charts once resolved

Hi @red-pizza-28006! The main use case for Data Lake ingestion is for organizations that aren’t using Glue with S3

How does Azure Blob Storage look from a roadmap perspective to mimic the S3 ingest of parquet, json etc?