High Signal Podcasts Evidence ledger
Method
Browse
← Back to evidence

Evidence receipt / evaluation

Published · transcript-backed

Nathan Labenz: evaluation

12 Jul 2026 The Cognitive Revolution Alignment with Awakening: Davidad on Moral Realism, AI Wisdom, & why His p(Doom) is Down to 5%

“In today's world, one of the reasons I can't send my AIS out to do all my stuff for me is that humans are pretty clever about tricking and ripping off the AIS, so I'm not sure how we avoid a situation.”

— Nathan Labenz

Source trail

Everything needed to verify it.

Speaker
Nathan Labenz
Attribution
Verified speaker
Claim type
evaluation
Recorded
12 Jul 2026
Publisher
The Cognitive Revolution

Transcript context

…Kind of if, if they're interacting outside kind of households, yes. Yeah, and there's just also, they're going to be agents in the economy, and the economy is like fundamentally competitive. And, you know, if you are not kind of set up to play some of these games, you're going to be the one taken advantage of right in, if only by humans. In today's world, one of the reasons I can't send my AIS out to do all my stuff for me is that humans are pretty clever about tricking and ripping off the AIS, so I'm not sure how we avoid a situation. It seems like a very natural next thing to do would be to train models in multi agent competitive scenarios, but that's clearly gonna reward deception in some cases so maybe we can live. With that or I would just say don't. I would say, don't I, I would say, you know, it, that it's, it's actually be, it would be great if mass adoption of AI agents driven by just how much more they can do per minute or per dollar, results in basically negotiation negotiations becoming more honest. Like, yes, there's gonna that you're gonna be at a disadvantage if you negotiate honestly. But like, do the AIS really need an advantage? No, they're gonna be just so productive. And I think that that, you know, the, the, the deception, you know, being being fooled by deceptive input is just a completely different dimension from being willing to produce deceptive output. And I think we should aim for it neither.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.

Search evidence