Tim Scarfe: evaluation

Transcript context

…some basic things to improve competitiveness. So it's making competitiveness not be, let's be the first to build super intelligence, which is what the sort of Manhattan project strategy pushes toward. But instead, its competition is more, you know, market share in the in across the globe of people using your AIs as opposed to Chinese AIs in your supply chain security instead. So that's kind of what's in the paper at a high level. There's lots of other specific things in there, like assuming high levels of automation, what are ways that you distribute power, what are things about AI rights, what are reasonable alignment targets that are actually implementable compared to, you know, vague philosophical, you know, words like dignity or something like that. So we'll we'll touch on a lot of those in the the expert version of the superintelligence strategy. But hopefully, that gives gives some sense of its its content. So it's trying to for all of the key questions, we'll try and have some answer to what to do about AI and what to do about superintelligence. Yeah. I mean, I I guess 1 1 of the the the main things is this analogies thing. So as as you've said, we use analogies like, electricity. And I think that's quite a good 1, because as as AI becomes enmeshed in into society, imagine how hard it would be to shut down a power station. You know? Like and this is part of the loss of control thing. It's just gonna be everywhere, and it's just not really something that we can just quickly shut down. But it's also been, compared to software or even an operating system by Andre Kapathi, the the printing press, for example. And, like, the the thrust of your paper is saying, actually, guys, we need to use the analogy of of nuclear. Right? You know, fissile material is analogous to chips. Yeah. Yeah. Or or more broadly, for geo for analyzing this in a geopolitical way, it's useful to model this as nuclear chem and bio. They're all dual use. Fissile materials can be used for nuclear weapons. They can be used for for you you can use you can use nuclear technology for for energy. Chemical can be used for chemical weapons or chemicals in, you know, the economy and biology as well can be bioweapons and can help you with health care. So Well for all of those, I I think it I think it's like that. They're potentially catastrophic dual use technologies, and I think when talking about geopolitical strategy, I think that's a productive analogy.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.