Ask HN: Why don't LLM APIs have a first-class test mode?

By masternoob · 2026-09-03 · 1 points · 4 comments

Context: At work, we’re getting ready to stress-test a chatbot for scalability. One fairly obvious issue came up: if our load tests exercise the real OpenAI/Claude APIs, a scalability test can quickly turn into a token-spending test. Fair enough. We shouldn’t burn real infe…

Open the full discussion on BetterNews