book / likes
The Ten Great Inventions of Evolution
“I love that area of biology. There’s people, there’s a great book by Nick Lane, one of the top experts in this area called The Ten Great Inventions of Evolution.”
Public evidence record
CEO · Google DeepMind
Books, apps, and tools
book / likes
“I love that area of biology. There’s people, there’s a great book by Nick Lane, one of the top experts in this area called The Ten Great Inventions of Evolution.”
Claim ledger
48 transcript-backed records
01 / recommendation
“I love that area of biology. There’s people, there’s a great book by Nick Lane, one of the top experts in this area called The Ten Great Inventions of Evolution.”
02 / evaluation
“You can learn something kind of equally valuable from an experiment that doesn’t work.”
03 / belief
“Definitely. And I think we’ll need new governance structures, institutions probably to help with this transition.”
04 / belief
“We have systems I think that can do incremental hill climbing, and that’s a kind of bigger question about is that all that’s needed from here, or do we actually need one or two more big breakthroughs.”
05 / belief
“I think compute, there’s the amount of compute you have for training, often it needs to be co-located, so actually even bandwidth constraints between data centers can affect that. So there’s additional constraints even there and that’s important for training, obviously the largest models you can, but there’s also because now AI systems are in products and being used by billions of people around the world, you need a ton of inference compute now.”
06 / belief
“I think he foresaw a lot of what would happen with learning machines, systems that are grown, I think he called it rather than programmed.”
07 / belief
“A highly creative process that I think just a kind of naive search on top of a model won’t be enough for that.”
08 / belief
“I think to the extent that it can predict the next frames in a coherent way, that is a form of understanding, not in the anthropomorphic version of, it’s not some kind of deep philosophical understanding of what’s going on, I don’t think these systems have that, but they certainly have modeled enough of the dynamics, put it that way, that they can pretty accurately generate whatever it is, eight seconds of consistent video that by eye, at least at a glance, is quite hard to distinguish what the issues are.”
09 / belief
“New types of solar material, solar panel material room temperature superconductors has always been on my list of dream breakthroughs, and optimal batteries. And I think a solution to any one of those things would be absolutely revolutionary for climate and energy usage.”
10 / belief
“Partly because I think there’s enough data, and it’s been proven to get the systems to be pretty good.”
11 / belief
“Then maybe he got inspired by what AlphaGo was doing to then conjure this incredible inspirational moment, captured very well in the documentary about it. And I think that’ll continue in many domains where there’s this, at least again for the foreseeable future, of the humans bringing in their ingenuity and asking the right question, let’s say, and then utilizing these tools in a way that then cracks a problem.”
12 / belief
“Actually, I think we’re going to enter an era of AI-generated interfaces that are probably personalized to you, so it fits the way that you, your aesthetic, your feel, the way that your brain works and the AI kind of generates that depending on the task.”
13 / belief
“I agree and I would love to see a lot of people, all of the other labs talk about science, but I think we’re really the only ones using it for science and doing that.”
14 / evaluation
“Proteins fold in milliseconds in our bodies, so somehow physics solves this problem that we’ve now also solved computationally. And I think the reason that’s possible is that in nature, natural systems have structure because they were subject to evolutionary processes that shape them.”
15 / preference
“I would say I’m not sure it’s even desirable because that’s a kind of hard takeoff scenario.”
16 / recommendation
“What you want to be able to do is potentially anything in that game environment. And I think the only way you can do that is to have generated systems, systems that will generate that on the fly.”
17 / uncertainty
“Some things may turn out to be, and hopefully way easier than we thought, but it may be there’s some really hard problems that are harder than we guessed today, and I think we don’t know that for sure.”
18 / evaluation
“Of course people arguing about that now and mind’s quite a high bar and always has been of can we match the cognitive functions that the brain has? So we know our brains are pretty much general Turing machines approximate, and of course we created incredible modern civilization with our minds.”
19 / evaluation
“Along with relentless shipping of that progress is being very successful and it’s unbelievably competitive, the whole space, the whole AI space, with some of the greatest entrepreneurs and leaders and companies in the world, all competing now because everyone’s realized how important AI is.”
20 / evaluation
“Because then it veers more from just engineering to true research, and research plus engineering, and that’s our sweet spot and I think that’s harder.”
21 / evaluation
“Of course that’s why we pioneered, and what DeepMind is sort of famous for, using games as a proving ground. That’s partly because it’s efficient to research in that domain.”
22 / belief
“The systems that are around today are not dangerous, in my opinion, but in a few years they might have potential.”
23 / belief
“Obviously, society is adding more data all the time to the Internet and things like that. I think that there’s a lot of scope for creating synthetic data.”
24 / belief
“Perhaps chaining thought, lines of reasoning, together and using search to explore massive spaces of possibility. I think that’s kind of missing from our current large models.”
25 / belief
“If you improve the models, then I think your search can be more efficient and therefore you can get further with your search.”
26 / belief
“I would say that’s still not a perfectly understood mapping, but it’s an interesting one that we’re getting better and better at.”
27 / belief
“I think if it’s not properly grounded, the system won’t be able to achieve those goals properly.”
28 / belief
“In my view, the only sensible approach when you have huge uncertainty is to be cautiously optimistic and use the scientific method to try and have as much foresight and understanding about what’s coming down the line and the consequences of that before it happens.”
29 / belief
“I think the next versions of this over the next year, 18 months, we’ll maybe have some contextual understanding of the environment around you through a camera or a phone or some glasses.”
30 / belief
“I think at the stage we’re at now, there are huge amounts of world-class engineering that have to go into building the frontier systems.”
31 / belief
“As these systems become more powerful and more general and more capable, I think one has to look at the access question.”
32 / belief
“Actually my thesis, and that paper particularly that started that area of imagination in neuroscience, was showing that first of all memory, at least human memory, is a reconstructive process.”
33 / belief
“I think we’re getting to the stage where our systems could help the best human scientists make their breakthroughs quicker, almost triage the search space in some ways.”
34 / belief
“We have those implicitly internally in various safety councils that people like Shane chair and so on. But it’s time for us to talk about that more publicly I think.”
35 / belief
“I’m hoping we’re going to see a lot more of this kind of transfer, but I think things like getting better at coding and math, and then generally improving your reasoning.”
36 / belief
“I think what we’ve got to do in the next few years, in the time before those systems start arriving, is come up with the right evaluations and metrics.”
37 / belief
“I think if a capability like that was discovered through red teaming or external testing, independent testers like government institutes or academia or whatever, then we would have to fix that loophole.”
38 / belief
“If ChatGPT and chatbots hadn’t gotten the interest they ended up getting—which I think was quite surprising to everyone that people were ready to use these things even though they were lacking in certain directions, impressive though they are—then we would have produced more specialized systems built off of the main track, like AlphaFold and AlphaGo, our scientific work.”
39 / evaluation
“I think the history of human endeavors has been such that once you know something’s possible it’s easier to push hard in that direction, because you know it’s a question of effort, a question of when and not if.”
40 / recommendation
“I think that’s actually one of the areas where a lot more research needs to be done, the kind of mechanistic analysis of the representations that these systems build up.”
41 / preference
“I think that’s valuable because those ideas and those algorithms should also work when you have some knowledge too.”
42 / evaluation
“The good news is that with the popularity of the recent chatbot systems, I think that has woken up many of these other parts of society to the fact that this is coming and what it will be like to interact with these systems.”
43 / evaluation
“I think we get some grounding through the RLHF feedback systems because obviously the human raters are by definition, grounded people.”
44 / evaluation
“I think we’re still in the nascent stage of this, of data curation and data analysis and actually analyzing the holes that you have in your data distribution.”
45 / recommendation
“Part of the issue is that with these very general systems, there’s so much surface area to cover about how these systems behave. So I think we are going to need some automated testing.”
46 / recommendation
“I think that maybe in the next three, four, five years, we would also want air gaps and various other things that are known in the security community. So I think that’s key and I think all frontier labs should be doing that because otherwise for rogue nation-states and other dangerous actors, there would obviously be a lot of incentive for them to steal things like the weights.”
47 / evaluation
“I think we don’t know how long AGI is going to be. We always used to say, back even when we started DeepMind, that we don’t have to wait for AGI in order to bring incredible benefits to the world.”
48 / prediction
“I will say that when we started DeepMind back in 2010, we thought of it as a 20-year project. And I think we’re on track actually, which is kind of amazing for 20-year projects because usually they’re always 20 years away.”