Frontier models have recently shown a trend of decreasing or plateauing scale in pre-training.
We had increasing scale up to maybe GPT 4.5 and now we're seeing decreasing or plateauing scale.
We had increasing scale up to maybe GPT 4.5 and now we're seeing decreasing or plateauing scale.