An 8.6 GB model that serves only 7 requests a second
By sudomax · 2026-08-26 · 7 points · 1 comments
https://mapathak-commits.github.io/inference-wall/articles/part-1/
By sudomax · 7 points · 1 comments · on Hacker News, read on BetterNews.
Open the full discussion on BetterNews