Hey everyone! We just pushed some updates to the Daft docs on optimization and debugging — especially around memory and partitioning. • Managing memory: tips on how to tune Daft to lower memory usage and avoid OOMs. • Optimizing partitions / batches: details on how Daft parallelizes data across cores / machines, and how to control it. Do check them out if you face any difficulties like high memory usage or low cpu utilization within your workloads!

Thanks. Perfect timing. I was gonna find how to batch data to avoid crashing