Show HN: Gall – Inkling 2 Mini on 24GB M2, frees RAM between messages
By ltrg · 2026-11-22 · 5 points · 1 comments
https://github.com/ltrgoddard/gall
Thinking Machines Lab gives 32GB as the minimum RAM requirement for Inkling 2 Mini on Mac, but with the Q3 quant I felt it must be possible to get somewhere reasonable on my 24GB M2 MacBook Air. Llama.cpp wasn't cutting it even with patches, so I spent this week's Fable allowanc…
Open the full discussion on BetterNews