Running a 35B LLM at 128K Context, Full Speed, on €870 of Used Hardware
By dexmac221 · 2026-08-02 · 1 points · 0 comments
https://medium.com/ai-advances/running-a-35b-llm-at-128k-context-full-speed-on-870-of-used-hardware-no-cloud-required-c4f7629810b8
By dexmac221 · 1 points · 0 comments · on Hacker News, read on BetterNews.
Open the full discussion on BetterNews