A garbage collector for LLM context windows, written in Rust

By gionag · 2026-10-28 · 1 points · 0 comments

Hi HN, Like many of you, I spend a lot of time coding with Codex and switching between cloud and local models. As a software engineer, something I never understood, and honestly hated—was `/compact` and the way it’s designed. On local models my GPU screams, and after a few…

Open the full discussion on BetterNews