High Signal Podcasts Evidence ledger
Method
Browse
← All source episodes

Dwarkesh Podcast / episode intelligence

Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold

28 Feb 2024 31 published claims 2 attributable people

Speakers in the public record

Claim mix

belief 17evaluation 6prediction 3recommendation 3uncertainty 1preference 1

Evidence policy

Every row below preserves an exact excerpt. Identified speakers are linked; unresolved voices are labeled and excluded from people counts.

Claim ledger

The useful parts, with receipts.

31 published records

01 / prediction

Maybe it thinks in alien concepts and you can’t really monitor the million-line pull request because you can’t really understand the whole thing and you can’t give labels.

“Maybe it thinks in alien concepts and you can’t really monitor the million-line pull request because you can’t really understand the whole thing and you can’t give labels.”
Speaker
Dwarkesh Patel
Publisher
Dwarkesh Podcast

02 / prediction

One is that as these models get smarter, they are going to be able to operate in domains where we just can’t generate enough human labels, just because we’re not smart enough.

“One is that as these models get smarter, they are going to be able to operate in domains where we just can’t generate enough human labels, just because we’re not smart enough.”
Speaker
Dwarkesh Patel
Publisher
Dwarkesh Podcast

03 / evaluation

Of course that’s why we pioneered, and what DeepMind is sort of famous for, using games as a proving ground. That’s partly because it’s efficient to research in that domain.

“Of course that’s why we pioneered, and what DeepMind is sort of famous for, using games as a proving ground. That’s partly because it’s efficient to research in that domain.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

05 / belief

Obviously, society is adding more data all the time to the Internet and things like that. I think that there’s a lot of scope for creating synthetic data.

“Obviously, society is adding more data all the time to the Internet and things like that. I think that there’s a lot of scope for creating synthetic data.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

06 / belief

Perhaps chaining thought, lines of reasoning, together and using search to explore massive spaces of possibility. I think that’s kind of missing from our current large models.

“Perhaps chaining thought, lines of reasoning, together and using search to explore massive spaces of possibility. I think that’s kind of missing from our current large models.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

09 / uncertainty

There’s a perception that maybe other labs are more compute-efficient than DeepMind has been with Gemini. I don’t know what you make of that perception.

“There’s a perception that maybe other labs are more compute-efficient than DeepMind has been with Gemini. I don’t know what you make of that perception.”
Speaker
Dwarkesh Patel
Publisher
Dwarkesh Podcast

11 / belief

In my view, the only sensible approach when you have huge uncertainty is to be cautiously optimistic and use the scientific method to try and have as much foresight and understanding about what’s coming down the line and the consequences of that before it happens.

“In my view, the only sensible approach when you have huge uncertainty is to be cautiously optimistic and use the scientific method to try and have as much foresight and understanding about what’s coming down the line and the consequences of that before it happens.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

12 / belief

I think the next versions of this over the next year, 18 months, we’ll maybe have some contextual understanding of the environment around you through a camera or a phone or some glasses.

“I think the next versions of this over the next year, 18 months, we’ll maybe have some contextual understanding of the environment around you through a camera or a phone or some glasses.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

15 / belief

Actually my thesis, and that paper particularly that started that area of imagination in neuroscience, was showing that first of all memory, at least human memory, is a reconstructive process.

“Actually my thesis, and that paper particularly that started that area of imagination in neuroscience, was showing that first of all memory, at least human memory, is a reconstructive process.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

16 / belief

I think we’re getting to the stage where our systems could help the best human scientists make their breakthroughs quicker, almost triage the search space in some ways.

“I think we’re getting to the stage where our systems could help the best human scientists make their breakthroughs quicker, almost triage the search space in some ways.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

17 / belief

We have those implicitly internally in various safety councils that people like Shane chair and so on. But it’s time for us to talk about that more publicly I think.

“We have those implicitly internally in various safety councils that people like Shane chair and so on. But it’s time for us to talk about that more publicly I think.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

18 / belief

I’m hoping we’re going to see a lot more of this kind of transfer, but I think things like getting better at coding and math, and then generally improving your reasoning.

“I’m hoping we’re going to see a lot more of this kind of transfer, but I think things like getting better at coding and math, and then generally improving your reasoning.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

20 / belief

I think if a capability like that was discovered through red teaming or external testing, independent testers like government institutes or academia or whatever, then we would have to fix that loophole.

“I think if a capability like that was discovered through red teaming or external testing, independent testers like government institutes or academia or whatever, then we would have to fix that loophole.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

21 / belief

If ChatGPT and chatbots hadn’t gotten the interest they ended up getting—which I think was quite surprising to everyone that people were ready to use these things even though they were lacking in certain directions, impressive though they are—then we would have produced more specialized systems built off of the main track, like AlphaFold and AlphaGo, our scientific work.

“If ChatGPT and chatbots hadn’t gotten the interest they ended up getting—which I think was quite surprising to everyone that people were ready to use these things even though they were lacking in certain directions, impressive though they are—then we would have produced more specialized systems built off of the main track, like AlphaFold and AlphaGo, our scientific work.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

22 / evaluation

I think the history of human endeavors has been such that once you know something’s possible it’s easier to push hard in that direction, because you know it’s a question of effort, a question of when and not if.

“I think the history of human endeavors has been such that once you know something’s possible it’s easier to push hard in that direction, because you know it’s a question of effort, a question of when and not if.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

23 / recommendation

I think that’s actually one of the areas where a lot more research needs to be done, the kind of mechanistic analysis of the representations that these systems build up.

“I think that’s actually one of the areas where a lot more research needs to be done, the kind of mechanistic analysis of the representations that these systems build up.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

25 / evaluation

The good news is that with the popularity of the recent chatbot systems, I think that has woken up many of these other parts of society to the fact that this is coming and what it will be like to interact with these systems.

“The good news is that with the popularity of the recent chatbot systems, I think that has woken up many of these other parts of society to the fact that this is coming and what it will be like to interact with these systems.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

27 / evaluation

I think we’re still in the nascent stage of this, of data curation and data analysis and actually analyzing the holes that you have in your data distribution.

“I think we’re still in the nascent stage of this, of data curation and data analysis and actually analyzing the holes that you have in your data distribution.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

28 / recommendation

Part of the issue is that with these very general systems, there’s so much surface area to cover about how these systems behave. So I think we are going to need some automated testing.

“Part of the issue is that with these very general systems, there’s so much surface area to cover about how these systems behave. So I think we are going to need some automated testing.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

29 / recommendation

I think that maybe in the next three, four, five years, we would also want air gaps and various other things that are known in the security community. So I think that’s key and I think all frontier labs should be doing that because otherwise for rogue nation-states and other dangerous actors, there would obviously be a lot of incentive for them to steal things like the weights.

“I think that maybe in the next three, four, five years, we would also want air gaps and various other things that are known in the security community. So I think that’s key and I think all frontier labs should be doing that because otherwise for rogue nation-states and other dangerous actors, there would obviously be a lot of incentive for them to steal things like the weights.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

30 / evaluation

I think we don’t know how long AGI is going to be. We always used to say, back even when we started DeepMind, that we don’t have to wait for AGI in order to bring incredible benefits to the world.

“I think we don’t know how long AGI is going to be. We always used to say, back even when we started DeepMind, that we don’t have to wait for AGI in order to bring incredible benefits to the world.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast

31 / prediction

I will say that when we started DeepMind back in 2010, we thought of it as a 20-year project. And I think we’re on track actually, which is kind of amazing for 20-year projects because usually they’re always 20 years away.

“I will say that when we started DeepMind back in 2010, we thought of it as a 20-year project. And I think we’re on track actually, which is kind of amazing for 20-year projects because usually they’re always 20 years away.”
Speaker
Demis Hassabis
Publisher
Dwarkesh Podcast
Search evidence