High Signal Podcasts Evidence ledger
Method
Browse
← All source episodes

Lex Fridman Podcast / episode intelligence

#431 – Roman Yampolskiy: Dangers of Superintelligent AI

2 Jun 2024 37 published claims 2 attributable people

Speakers in the public record

Claim mix

belief 18evaluation 7uncertainty 4observation 3prediction 2recommendation 2commitment 1

Evidence policy

Every row below preserves an exact excerpt. Identified speakers are linked; unresolved voices are labeled and excluded from people counts.

Claim ledger

The useful parts, with receipts.

37 published records

01 / uncertainty

I don’t know it writes Chinese poetry, hypothetical, I know it does, but we haven’t tested for all possible capabilities and we are not explicitly designing them.

“I don’t know it writes Chinese poetry, hypothetical, I know it does, but we haven’t tested for all possible capabilities and we are not explicitly designing them.”
Publisher
Lex Fridman Podcast

02 / belief

I think to me, consciousness is closely tied to suffering. So if you can illustrate your capacity to suffer… But I guess with words, there’s so much data that you can pretend you’re suffering and you can do so very convincingly.

“I think to me, consciousness is closely tied to suffering. So if you can illustrate your capacity to suffer… But I guess with words, there’s so much data that you can pretend you’re suffering and you can do so very convincingly.”
Speaker
Lex Fridman
Publisher
Lex Fridman Podcast

03 / belief

Oh, I see. That we kind of build Oracle verifiers or rather we build verifiers we believe to be Oracles and then we start to, without any proof, use them as if they’re Oracle verifiers.

“Oh, I see. That we kind of build Oracle verifiers or rather we build verifiers we believe to be Oracles and then we start to, without any proof, use them as if they’re Oracle verifiers.”
Speaker
Lex Fridman
Publisher
Lex Fridman Podcast

05 / belief

If we had capability of ahead of the run, before the training run to register exactly what capabilities that next model will have at the end of the training run, and we accurately guessed all of them, I would say you’re right, “We can definitely go ahead with this run.

“If we had capability of ahead of the run, before the training run to register exactly what capabilities that next model will have at the end of the training run, and we accurately guessed all of them, I would say you’re right, “We can definitely go ahead with this run.”
Publisher
Lex Fridman Podcast

08 / evaluation

You can look it up. But even if they’re wrong, I’m just saying this is right now the best we have, this is what humanity came up with as the predicted date.

“You can look it up. But even if they’re wrong, I’m just saying this is right now the best we have, this is what humanity came up with as the predicted date.”
Publisher
Lex Fridman Podcast

14 / belief

Any kid in the garage can train a model. So, a lot of it is, in my opinion, just safety theater, security theater where we saying, “Oh, it’s illegal to train models so big.

“Any kid in the garage can train a model. So, a lot of it is, in my opinion, just safety theater, security theater where we saying, “Oh, it’s illegal to train models so big.”
Publisher
Lex Fridman Podcast

18 / uncertainty

I guess your answer would be yes, but we don’t know how to do that and we need to invest a lot of effort into figuring out how to do that, but it’s unlikely.

“I guess your answer would be yes, but we don’t know how to do that and we need to invest a lot of effort into figuring out how to do that, but it’s unlikely.”
Speaker
Lex Fridman
Publisher
Lex Fridman Podcast

20 / belief

I think there is multiple Turing Award winners that is quite… You can have this one and one just came out kind of similar, “Managing Extreme-“ … one just came out kind of similar, managing extremely high risks.

“I think there is multiple Turing Award winners that is quite… You can have this one and one just came out kind of similar, “Managing Extreme-“ … one just came out kind of similar, managing extremely high risks.”
Publisher
Lex Fridman Podcast

21 / belief

I may be wrong, but I think Stuart Russell’s ideas are all about machines which are uncertain about what humans want and trying to learn better and better what we want.

“I may be wrong, but I think Stuart Russell’s ideas are all about machines which are uncertain about what humans want and trying to learn better and better what we want.”
Publisher
Lex Fridman Podcast

22 / uncertainty

Many things are real on the internet, but I don’t think anyone, if I told them, “Sit down [inaudible 01:54:56] function to feel pain,” they would go beyond having an integer variable called pain and increasing the count. So we don’t know how to do it.

“Many things are real on the internet, but I don’t think anyone, if I told them, “Sit down [inaudible 01:54:56] function to feel pain,” they would go beyond having an integer variable called pain and increasing the count. So we don’t know how to do it.”
Publisher
Lex Fridman Podcast

29 / recommendation

The transition from horses to cars, there’s a really nice channel that I recommend people check out, Pessimist Archive that documents all the fear-mongering about technology that’s happened throughout history.

“The transition from horses to cars, there’s a really nice channel that I recommend people check out, Pessimist Archive that documents all the fear-mongering about technology that’s happened throughout history.”
Speaker
Lex Fridman
Publisher
Lex Fridman Podcast

30 / prediction

You basically have to perform an experiment on 8 billion humans without their consent. And even if they want to give you consent, they can’t because they cannot give informed consent.

“You basically have to perform an experiment on 8 billion humans without their consent. And even if they want to give you consent, they can’t because they cannot give informed consent.”
Publisher
Lex Fridman Podcast

32 / evaluation

It matters how the deaths happen, whether it’s literally murdered by the AI system, then one is a problem, but if it’s accidents because of increased reliance on automation for example, so when airplanes are flying in an automated way, maybe the number of plane crashes increased by 17% or something, and then you’re like, “Okay, do we really want to rely on automation?

“It matters how the deaths happen, whether it’s literally murdered by the AI system, then one is a problem, but if it’s accidents because of increased reliance on automation for example, so when airplanes are flying in an automated way, maybe the number of plane crashes increased by 17% or something, and then you’re like, “Okay, do we really want to rely on automation?”
Speaker
Lex Fridman
Publisher
Lex Fridman Podcast

33 / evaluation

Absolutely true. But in another paper I argue that those accidents do not actually prevent people from continuing with research and actually they kind of serve like vaccines.

“Absolutely true. But in another paper I argue that those accidents do not actually prevent people from continuing with research and actually they kind of serve like vaccines.”
Publisher
Lex Fridman Podcast

34 / recommendation

I think one of the challenges here is where is the dangers and the intuition the [inaudible 00:54:40] and others have is, let’s keep in the open building AI systems until the dangers start rearing their heads and they become more explicit, they start being case studies, illustrative case studies that show exactly how the damage by AD systems is done, then regulation can step in.

“I think one of the challenges here is where is the dangers and the intuition the [inaudible 00:54:40] and others have is, let’s keep in the open building AI systems until the dangers start rearing their heads and they become more explicit, they start being case studies, illustrative case studies that show exactly how the damage by AD systems is done, then regulation can step in.”
Speaker
Lex Fridman
Publisher
Lex Fridman Podcast

35 / evaluation

I have a paper where I equate passing Turing tests to solving AI complete problems because you can encode any questions about any domain into the Turing test.

“I have a paper where I equate passing Turing tests to solving AI complete problems because you can encode any questions about any domain into the Turing test.”
Publisher
Lex Fridman Podcast

36 / commitment

I’m personally excited for the future and believe it will be a good one in part because of the amazing technological innovation we humans create, but we must absolutely not do so with blinders on ignoring the possible risks, including existential risks of those technologies.

“I’m personally excited for the future and believe it will be a good one in part because of the amazing technological innovation we humans create, but we must absolutely not do so with blinders on ignoring the possible risks, including existential risks of those technologies.”
Speaker
Lex Fridman
Publisher
Lex Fridman Podcast
Search evidence