Show HN: Open-source verification and tuning layer for self-hosted LLMs
By tschillaci · 2026-07-17 · 2 points · 0 comments
https://github.com/colomalabs/coloma
Hi HN, Thomas here, I'm a Machine Learning, and I've been deploying models in prod for the last 5 years and decided it was time to open-source some of my learnings! In Coloma you'll find my vLLM tuner, I use it to ensure models don't OOM at runtime, and are optimized for the met…
Open the full discussion on BetterNews