Title:
Unified Data Fabric: Harmonizing Warehouses and Lakes for Scalable Analytics
Abstract:
This paper introduces a converged architectural paradigm designed to bridge the silos between analytical data warehouses and unstructured data lakes. By leveraging open storage formats and a transactional metadata overlay, this model delivers high-performance SQL querying while enabling direct data access for machine learning and advanced analytics. We demonstrate how this integrated approach addresses longstanding challenges in data reliability, freshness, cost, and governance—key concerns in modern Big Data and Business Intelligence ecosystems. Preliminary results from a Parquet-based implementation show competitive performance against leading cloud warehouses in standardized TPC-DS benchmarks, validating the feasibility of unifying scalable data management under a single, open-format platform.