Want to achieve near-100% GPU utilization processi...
# announcements
c
Want to achieve near-100% GPU utilization processing millions of text documents with Qwen3? Most ML teams struggle to keep GPUs from sitting idle, juggling multi-step pipelines across different clusters. With Daft, we seamlessly pipeline network downloads, CPU preprocessing, GPU inference, and distributed writes. All in one script, on a single cluster, with almost 100% GPU utilization. See how we used Qwen3-Embedding-0.6B to compute embeddings on the RedPajama Dataset across 8×A10G nodes, while writing simultaneously to turbopuffer—without breaking a sweat!

https://youtu.be/WI83lRzk7YE▾

🚀 8
❤️ 2
🙌 1