High Signal Podcasts Evidence ledger
Method
Browse
← Back to evidence

Evidence receipt / prediction

Published · transcript-backed

Paul Bloom: prediction

7 Aug 2024 Conversations with Tyler Paul Bloom on the Psychology of Children, and the Morality of Empathy and Disgust

“LLMs will succeed on them because they’ve seen thousands and thousands of instances on them.”

— Paul Bloom

Source trail

Everything needed to verify it.

Speaker
Paul Bloom
Attribution
Verified speaker
Claim type
prediction
Recorded
7 Aug 2024
Publisher
Conversations with Tyler

Transcript context

…Here’s a simple question. What’s the best test of whether someone or something has a theory of mind? I think sustained conversation. There are technical tests, like the false-belief task or Reading of the Mind in the Eyes task, but those are easily gamed. LLMs will succeed on them because they’ve seen thousands and thousands of instances on them. I think in conversation, a lack of theory of mind quickly reveals itself. Success of solving a Turing test is success of theory of mind. Claude 3 can converse very well, but I’m pretty sure it doesn’t have a theory of mind, or do you think it does?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.

Search evidence