Janas: Run LLMs larger than RAM by streaming experts from SSD
By khalidkhair · 2026-10-12 · 47 points · 20 comments
https://github.com/prabanta-dev/janas
By khalidkhair · 47 points · 20 comments · on Hacker News, read on BetterNews.
Open the full discussion on BetterNews