My "4-bit" quant was 6.2 bits per weight
By murphman · 2026-08-03 · 3 points · 0 comments
https://koleslaw.ai/blog/the-quantization-that-didnt-fit
By murphman · 3 points · 0 comments · on Hacker News, read on BetterNews.
Open the full discussion on BetterNews