Demis Hassabis: belief

Transcript context

…Yeah. How crucial is the scaling of compute to building AGI? That’s an engineering question. It’s almost a geopolitical question because it also integrated into that is supply chains and energy. A thing that you care a lot about, which is potentially fusion. So innovating on the side of energy also. Do you think we’re going to keep scaling compute? I think so, for several reasons. I think compute, there’s the amount of compute you have for training, often it needs to be co-located, so actually even bandwidth constraints between data centers can affect that. So there’s additional constraints even there and that’s important for training, obviously the largest models you can, but there’s also because now AI systems are in products and being used by billions of people around the world, you need a ton of inference compute now. And then on top of that there’s the thinking systems, the new paradigm of the last year that where they get smarter, the longer amount of inference time you give them at test time. So all of those things need a lot of compute and I don’t really see that slowing down, and as AI systems become better, they’ll become more useful and there’ll be more demand for them. So both from the training side, the training side actually is only just one part of that. It may even become the smaller part of what’s needed in the overall compute that’s required. Yeah, that’s one sort of almost meme-y kind of thing, which is the success in the incredible aspects of VL3. People kind of make fun of the more successful it becomes, the servers are sweating.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.