High Signal Podcasts Evidence ledger
Method
Browse
How the evidence works

Public evidence record

Ilya Sutskever

Co-founder · SSI

Claims
42
Episodes
2
Shows
1
Named items
0

Claim ledger

What Ilya said.

42 transcript-backed records

07 / evaluation

What I was alluding to with the person whose emotional center got damaged, it’s more that maybe what it suggests is that the value function of humans is modulated by emotions in some important way that’s hardcoded by evolution. And maybe that is important for people to be effective in the world.

“What I was alluding to with the person whose emotional center got damaged, it’s more that maybe what it suggests is that the value function of humans is modulated by emotions in some important way that’s hardcoded by evolution. And maybe that is important for people to be effective in the world.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

09 / belief

What’s the good world? It’s where we have these powerful human-like learners that are also… By the way, maybe there’s another thing we haven’t discussed on the spec of the superintelligent AI that I think is worth considering.

“What’s the good world? It’s where we have these powerful human-like learners that are also… By the way, maybe there’s another thing we haven’t discussed on the spec of the superintelligent AI that I think is worth considering.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

12 / belief

I think eventual convergence on the technical approach is probably going to happen as well, but I was alluding to convergence to the alignment strategies.

“I think eventual convergence on the technical approach is probably going to happen as well, but I was alluding to convergence to the alignment strategies.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

14 / belief

I think there will be a convergence of strategies where at some point, as AI becomes more powerful, it’s going to become more or less clearer to everyone what the strategy should be.

“I think there will be a convergence of strategies where at some point, as AI becomes more powerful, it’s going to become more or less clearer to everyone what the strategy should be.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

15 / uncertainty

I do think though that one of the things not addressed here, not discussed, is that with each increase in the AI’s capabilities, I think there will be some kind of changes, but I don’t know exactly which ones, in how things are being done.

“I do think though that one of the things not addressed here, not discussed, is that with each increase in the AI’s capabilities, I think there will be some kind of changes, but I don’t know exactly which ones, in how things are being done.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

16 / observation

The counterpoint is, “Hey, it is useful for the world to see powerful AI. It is useful for the world to see powerful AI because that’s the only way you can communicate it.

“The counterpoint is, “Hey, it is useful for the world to see powerful AI. It is useful for the world to see powerful AI because that’s the only way you can communicate it.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

19 / prediction

Now, from 2020 to 2025, it was the age of scaling—maybe plus or minus, let’s add error bars to those years—because people say, “This is amazing.

“Now, from 2020 to 2025, it was the age of scaling—maybe plus or minus, let’s add error bars to those years—because people say, “This is amazing.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

21 / evaluation

The reason that the term AGI exists is, in my opinion, not so much because it’s a very important, essential descriptor of some end state of intelligence, but because it is a reaction to a different term that existed, and the term is narrow AI.

“The reason that the term AGI exists is, in my opinion, not so much because it’s a very important, essential descriptor of some end state of intelligence, but because it is a reaction to a different term that existed, and the term is narrow AI.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

23 / prediction

Because what will happen as a result is that now the AI understands something, and we understand it too, because now the understanding is transmitted wholesale.

“Because what will happen as a result is that now the AI understands something, and we understand it too, because now the understanding is transmitted wholesale.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

24 / evaluation

In terms of utility though, I think there is a thing where there is this complexity-robustness tradeoff, where complex things can be very useful, but simple things are very useful in a very broad range of situations.

“In terms of utility though, I think there is a thing where there is this complexity-robustness tradeoff, where complex things can be very useful, but simple things are very useful in a very broad range of situations.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

26 / belief

I think that relying on people to teach our models to do things, especially to make sure that they are well-behaved and they don't produce false things is an extremely sensible thing to do.

“I think that relying on people to teach our models to do things, especially to make sure that they are well-behaved and they don't produce false things is an extremely sensible thing to do.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

27 / prediction

If it somehow ends up being the case that you really want them to be reliable and they ended up not being reliable, or if reliability turned out to be harder than we expect.

“If it somehow ends up being the case that you really want them to be reliable and they ended up not being reliable, or if reliability turned out to be harder than we expect.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

29 / prediction

I expect there's going to be a convergence-divergence-convergence behavior, where there is a lot of convergence on the near term work, there's going to be some divergence on the longer term work.

“I expect there's going to be a convergence-divergence-convergence behavior, where there is a lot of convergence on the near term work, there's going to be some divergence on the longer term work.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

32 / prediction

Today when you use Copilot, how do you divide it up? So I expect at some point you ask your descendant of ChatGPT, you say — Hey, I'm thinking about this and this.

“Today when you use Copilot, how do you divide it up? So I expect at some point you ask your descendant of ChatGPT, you say — Hey, I'm thinking about this and this.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

36 / evaluation

The reason for that is that, as far as I know, neuroscientists are really convinced that the brain cannot implement backpropagation because the signals in the synapses only move in one direction.

“The reason for that is that, as far as I know, neuroscientists are really convinced that the brain cannot implement backpropagation because the signals in the synapses only move in one direction.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

38 / prediction

One thing I imagine is that we will be able to become more enlightened because we interact with an AGI which will help us see the world more correctly, and become better on the inside as a result of interacting.

“One thing I imagine is that we will be able to become more enlightened because we interact with an AGI which will help us see the world more correctly, and become better on the inside as a result of interacting.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

39 / prediction

We’ve made some progress but much more progress is possible. And so I would expect that ultimately, the thing that will really succeed is when we will have a small neural net that is well understood that’s been given the task to study the behavior of a large neural net that is not understood, to verify.

“We’ve made some progress but much more progress is possible. And so I would expect that ultimately, the thing that will really succeed is when we will have a small neural net that is well understood that’s been given the task to study the behavior of a large neural net that is not understood, to verify.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

41 / prediction

For example, I believe that Intel has fabs just like a few generations ago. So that means that if Intel wanted to they could produce something GPU-like from four years ago.

“For example, I believe that Intel has fabs just like a few generations ago. So that means that if Intel wanted to they could produce something GPU-like from four years ago.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

42 / prediction

Rather than achieving one mathematical definition, I think we will achieve multiple definitions that look at alignment from different aspects.

“Rather than achieving one mathematical definition, I think we will achieve multiple definitions that look at alignment from different aspects.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast
Search evidence