Daft v0.4.16 just dropped with a PACKED release :m...
# announcements
c
Daft v0.4.16 just dropped with a PACKED release 💪 ✨ Native Local Parquet Writer - Efficient local parquet processing without external dependencies (https://github.com/Eventual-Inc/Daft/pull/4260) 🛣️ Daft Roadmap - See what features the Daft team is prioritizing in the coming year (https://www.getdaft.io/projects/docs/en/stable/roadmap/) 🔧 Python Partitioning Classes - Better data organization and query optimization capabilities (https://github.com/Eventual-Inc/Daft/pull/4366) 🐠 Flotilla Scheduler & Planner - Enhanced distributed computing with smarter resource management ☁️ S3 Multipart Uploads - Native support for efficient large file uploads to S3-compatible storage 🐍 Optional Spark Dependencies - Cleaner installs with PySpark connector now optional (
pip install -U "daft[spark]"
) 🪟 Window Functions Tutorial - Transform complex analytical challenges into elegant solutions with Daft’s window functions (https://colab.research.google.com/github/Eventual-Inc/Daft/blob/main/tutorials/window_functions/window_functions.ipynb) 📊 Performance Wins: • Smart projection splitting for granular batching • Optimized morsel sizing for project/filter ops • Better batch sizing with URL download connections • CSV predicate pushdown improvements The team is cooking 🔥 Find the full release notes here: https://github.com/Eventual-Inc/Daft/releases/tag/v0.4.16
🚀 3
🔥 6
y
c
Hey @Yufan! We just dropped our website today so we're in the process of adding redirects - here's the right link: https://docs.getdaft.io/en/stable/roadmap/
🙌 1