SonicBoom – llama.cpp's own kernels, 14% faster decode via a graph compiler
By nalaginrut · 2026-10-13 · 2 points · 0 comments
https://github.com/hardenedlinux/sonicboom
By nalaginrut · 2 points · 0 comments · on Hacker News, read on BetterNews.
Open the full discussion on BetterNews