if AI progress is fast and you can increase the progress by scaling up more, you should just have more than 50% and not make profit.
Alessio Fanelli
Recommendations and personal stack
Insufficient evidence — no named books, apps, or tools yet.
Published claims
Remember the log returns to scale. If 70% would get you a very little bit of a smaller model through a factor of 1.4x... That extra $20 billion, each dollar there is worth much less to you because of the log-linear setup.
Why doesn't everyone spend 100% of their compute on training and not serve any customers? It's because if they didn't get any revenue, they couldn't raise money, they couldn't do compute deals, they couldn't buy more compute the next year.
So the underlying economics are profitable. The problem is you have this hellish demand prediction problem when you're buying the next year of compute and you might guess under and be very profitable but have no compute for research. Or you might guess over and you are not profitable and you have all the compute for research in the world.