Ask HN: Slow OpenAI Inference on AWS Bedrock

By timedude · 2026-09-15 · 2 points · 1 comments

Inference on AWS Bedrock for OpenAI models has been very slow and glitchy the last few days with today being the worst. Very long latency of over 5 minutes to first token. What's going on?

Open the full discussion on BetterNews