Evidence receipt / evaluation
Published · transcript-backedFrancois Chollet: evaluation
11 Jun 2024 Dwarkesh Podcast Francois Chollet — Why the biggest AI models can't solve simple puzzles
“If you just had the intelligence but it was not hooked up to an extensive memory, it would not be that useful because it would not have enough material to work from.”
Source trail
Everything needed to verify it.
- Speaker
- Francois Chollet
- Attribution
- Verified speaker
- Claim type
- evaluation
- Recorded
- 11 Jun 2024
- Publisher
- Dwarkesh Podcast
Transcript context
…I assume your intuition is not that. I'm curious why. My intuition is that this whole System 2 architecture is the hard part. It’s the very hard and unobvious part. Scaling up the interpolative memory is the easy part. It's literally just a big curve. All you need is more data. It's an interpolative representation of a data set. That's the easy part. The hard part is the architecture of intelligence. Memory and intelligence are separate components. We have the memory. We don't have the intelligence yet. I agree with you that having the memory is actually very useful. If you just had the intelligence but it was not hooked up to an extensive memory, it would not be that useful because it would not have enough material to work from. Former guest Trenton Bricken advanced an alternative hypothesis that intelligence is just hierarchically associated memory. When Sherlock Holmes goes into a crime scene he's extremely sample efficient. He can just look at a few clues and figure out who was the murderer. He's able to do that because he has learned higher level associations. It's memory in some fundamental sense. Here's one way to ask the question. In the brain, supposedly we do program synthesis, but it is just synapses connected to each other. Physically, it's got to be that you just query the right circuit, right?…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.