Ask HN: What are you using for LLM inference in production?

By chrislim · 2026-07-31 · 3 points · 0 comments

I started with OpenAI back in the GPT-3 days, then bounced between the major labs (with a brief interlude with Workers AI). I eventually settled on Gemini 2.5 Flash Lite as my workhorse, using it against structured data/vectors as a chatbot. It was cheap, good enough, and m…

Open the full discussion on BetterNews