Show HN: Shoehorn – Quantize any model down to run on your machine

By rhgraysonii · 2026-08-18 · 5 points · 1 comments

https://notactuallytreyanastasio.github.io/shoehorn/

Working on Mac, Linux, and Windows now. I include a simple GUI to find new models and get things built and set up. It is working quite well across a few models for me. The GitHub README and DESIGN.md files go into detail of the how/why and it's working remarkably well so fa…

Open the full discussion on BetterNews