Show HN: TurboQuant for mlx-lm (Apple Silicon)
By pythongiant · 2026-07-07 · 1 points · 1 comments
https://github.com/pythongiant/mlx_turboquant
Hi HN, I built mlx-turboquant, an implementation of Google's TurboQuant KV-cache compression algorithm for Apple's MLX framework. The repository includes quality benchmarks, memory benchmarks, and a modular implementation so individual pieces (PolarQuant, QJL, packing, codebooks…
Open the full discussion on BetterNews