High Signal Podcasts Evidence ledger
Method
Browse
← All source episodes

Dwarkesh Podcast / episode intelligence

Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence

27 Mar 2023 19 published claims 2 attributable people

Speakers in the public record

Claim mix

prediction 10evaluation 4belief 3uncertainty 1commitment 1

Evidence policy

Every row below preserves an exact excerpt. Identified speakers are linked; unresolved voices are labeled and excluded from people counts.

Claim ledger

The useful parts, with receipts.

19 published records

02 / belief

I think that relying on people to teach our models to do things, especially to make sure that they are well-behaved and they don't produce false things is an extremely sensible thing to do.

“I think that relying on people to teach our models to do things, especially to make sure that they are well-behaved and they don't produce false things is an extremely sensible thing to do.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

03 / prediction

If it somehow ends up being the case that you really want them to be reliable and they ended up not being reliable, or if reliability turned out to be harder than we expect.

“If it somehow ends up being the case that you really want them to be reliable and they ended up not being reliable, or if reliability turned out to be harder than we expect.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

05 / prediction

I expect there's going to be a convergence-divergence-convergence behavior, where there is a lot of convergence on the near term work, there's going to be some divergence on the longer term work.

“I expect there's going to be a convergence-divergence-convergence behavior, where there is a lot of convergence on the near term work, there's going to be some divergence on the longer term work.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

08 / prediction

Today when you use Copilot, how do you divide it up? So I expect at some point you ask your descendant of ChatGPT, you say — Hey, I'm thinking about this and this.

“Today when you use Copilot, how do you divide it up? So I expect at some point you ask your descendant of ChatGPT, you say — Hey, I'm thinking about this and this.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

12 / evaluation

The reason for that is that, as far as I know, neuroscientists are really convinced that the brain cannot implement backpropagation because the signals in the synapses only move in one direction.

“The reason for that is that, as far as I know, neuroscientists are really convinced that the brain cannot implement backpropagation because the signals in the synapses only move in one direction.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

15 / prediction

One thing I imagine is that we will be able to become more enlightened because we interact with an AGI which will help us see the world more correctly, and become better on the inside as a result of interacting.

“One thing I imagine is that we will be able to become more enlightened because we interact with an AGI which will help us see the world more correctly, and become better on the inside as a result of interacting.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

16 / prediction

We’ve made some progress but much more progress is possible. And so I would expect that ultimately, the thing that will really succeed is when we will have a small neural net that is well understood that’s been given the task to study the behavior of a large neural net that is not understood, to verify.

“We’ve made some progress but much more progress is possible. And so I would expect that ultimately, the thing that will really succeed is when we will have a small neural net that is well understood that’s been given the task to study the behavior of a large neural net that is not understood, to verify.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

18 / prediction

For example, I believe that Intel has fabs just like a few generations ago. So that means that if Intel wanted to they could produce something GPU-like from four years ago.

“For example, I believe that Intel has fabs just like a few generations ago. So that means that if Intel wanted to they could produce something GPU-like from four years ago.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast

19 / prediction

Rather than achieving one mathematical definition, I think we will achieve multiple definitions that look at alignment from different aspects.

“Rather than achieving one mathematical definition, I think we will achieve multiple definitions that look at alignment from different aspects.”
Speaker
Ilya Sutskever
Publisher
Dwarkesh Podcast
Search evidence