Evidence receipt / prediction
Published · transcript-backedIlya Sutskever: prediction
27 Mar 2023 Dwarkesh Podcast Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
“If it somehow ends up being the case that you really want them to be reliable and they ended up not being reliable, or if reliability turned out to be harder than we expect.”
Source trail
Everything needed to verify it.
- Speaker
- Ilya Sutskever
- Attribution
- Verified speaker
- Claim type
- prediction
- Recorded
- 27 Mar 2023
- Publisher
- Dwarkesh Podcast
Transcript context
…Give me an over-under. Ilya Sutskever The problem is that my error bars are in log scale. I could imagine a huge percentage, I could imagine a really disappointing small percentage at the same time. Okay, so let's take the counterfactual where it is a small percentage. Let's say it's 2030 and not that much economic value has been created by these LLMs. As unlikely as you think this might be, what would be your best explanation right now of why something like this might happen? I really don't think that's a likely possibility, that's the preface to the comment. But if I were to take the premise of your question, why were things disappointing in terms of real-world impact? My answer would be reliability. If it somehow ends up being the case that you really want them to be reliable and they ended up not being reliable, or if reliability turned out to be harder than we expect. I really don't think that will be the case. But if I had to pick one and you were telling me — hey, why didn't things work out? It would be reliability. That you still have to look over the answers and double-check everything. That just really puts a damper on the economic value that can be produced by those systems. Got it. They will be technologically mature, it’s just the question of whether they'll be reliable enough.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.