Hey y'all - has anyone played with <turbovec>? It'...
# random
r
Hey y'all - has anyone played with turbovec? It's pretty nifty what the bleeding edge of embedding quantization looks like, I embedded 207k arXiv abstracts and at 2-bit TurboQuant the index is absurdly small, ~53MB. Retails near-parity on R@10 with dense fp32 (0.85 vs 0.88).
🙌 1