Demis Hassabis: belief

Transcript context

…Actually, I’m curious how you think that will interface with LLMs. Obviously, DeepMind is at the frontier and has been for many years with systems like AlphaZero and so forth, having these agents which can think through different steps to get to an end outcome. Is there a path for LLMs to have this tree search kind of thing on top of them? How do you think about this? I think that’s a super promising direction. We’ve got to carry on improving the large models. We’ve got to carry on making them more and more accurate predictors of the world, making them more and more reliable world models. That’s clearly a necessary, but probably insufficient component of an AGI system. On top of that, we’re working on things like AlphaZero-like planning mechanisms on top that make use of that model in order to make concrete plans to achieve certain goals in the world. Perhaps chaining thought, lines of reasoning, together and using search to explore massive spaces of possibility. I think that’s kind of missing from our current large models. How do you get past the immense amount of compute that these approaches tend to require? Even the AlphaGo system was a pretty expensive system because you sort of had to run an LLM on each node of the tree. How do you anticipate that’ll get made more efficient?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.