Show HN: I stopped using an LLM gateway and put rate-limits/fallback in-process
By Buddo · 2026-09-06 · 3 points · 1 comments
https://github.com/LakBud/vernLLM
Sup HN. I built VernLLM cuz every LLM gateaway I looked at, meant adding a network hop just to get rate limiting, multi provider fallback, circuit breaking and other features. Needing to take a whole seperate service just to deploy, monitor and trust with my API keys is just ann…
Open the full discussion on BetterNews