Show HN: A minimalist proxy for your local LLM cluster (~1100 lines)

By snowy_robolamp · 2026-07-30 · 1 points · 0 comments

https://github.com/robolamp/smol-llm-proxy

Hi all! I made this small proxy when I built a small GPU cluster at home and wanted to share it with friends while keeping speed limits and token accounting. I also put a lot of effort in making it work as quick as possible, and IMO the result is worth sharing! It is not trying…

Open the full discussion on BetterNews