Ask HN: Are we trading model capacity for compute?
By olirex99 · 2026-10-08 · 1 points · 0 comments
Do you think we're trading off model size, and model capacity, for compute? Take looped transformers, which GPT-6 Astra is rumored to be based on. They increase compute while keeping the model's capacity almost fixed. So my question is, if we had an infinitely large model (with…
Open the full discussion on BetterNews