Inferssd – Run models larger than RAM or VRAM by streaming MoE experts from SSD
By oceansky · 2026-10-30 · 1 points · 0 comments
https://github.com/wici-ai/inferssd
By oceansky · 1 points · 0 comments · on Hacker News, read on BetterNews.
Open the full discussion on BetterNews