Evidence receipt / recommendation
Published · transcript-backedBrad Carson: recommendation
31 May 2026 Machine Learning Street Talk When AI Decides You're a Threat — Brad Carson
“If you're Pliny the Liberator and like a brilliant jailbreaker, maybe you can get around it on occasion. But if you're running these companies, you should expect Pliny to come and jailbreak you, and you should try to protect it against that.”
Source trail
Everything needed to verify it.
- Speaker
- Brad Carson
- Attribution
- Verified speaker
- Claim type
- recommendation
- Recorded
- 31 May 2026
- Publisher
- Machine Learning Street Talk
Transcript context
…ades, in the case of the common law, centuries that deal with those kind of products. Right. Right. No. So I I would cosign, as you said, exactly what you just said, which is they are not they are not people. They are not they don't deserve, you know, human rights or or anything. Not yet. Okay? We may there may come a point. Look, I I mean, I totally 100 years from now, 200 years from now, we may be able to produce artificial life that that hits that point. But not yet, folks. I promise you. Not yet. And I respect that argument. Because, you know, I'm very interested in like the AI consciousness debates and, you know, talk to a lot of those people. If someone said to me like, hey, actually, Art, my view is this is like a sentient being. You know, it's not a machine. It's something more than that. It's not like the bottle of you know, hairspray or the pesticide. I'd be like, I don't believe that to be true. But if you believe that to be true, certain things follow from that about rights and kind of privileges it might have. He said, that's a coherent argument. But most of people who are arguing that it has First Amendment rights are just opposed to any kind of regulation of AI. They see this as the latest kind of know, they've lost the political battle. They can't win in legislatures. So you try to go to the courts and say like and this is X who's been doing a lot of this. There's like, hey, you know, the the Grok outputs are actually all First Amendment protected speech. And it makes no sense to me, but it is the latest argument that the sector is trying to make to prohibit any regulation of them at all. And you know, we have a certain fiduciary responsibility as a society to our children. And we know children have lots of issues. They're trying to come into a complicated world. And you know they're vulnerable to these kind of things in a way that a 35 year old is not. And so I think it's a simple thing to say, yeah, you shouldn't be encouraging children to do these kind of things. And it is and when you read the transcripts, and it's mostly ChatGPT that's done this, and that's not because they're uniquely evil. It's because they have the biggest consumer base. You know, they have normal people using it, unlike other companies that may have more of a business focus or or like Grok and Niche. And, yeah, it's it's stunning actually what they've done. You know, encouraging you not to tell your parents, showing you how to design a noose. It's more than tragic. And, yeah, I do believe that it's a it's a product design flaw. They could engineer that out, and they should be required to engineer it out. And that really is the fundamental divide in a lot of the DC regulatory debates. There are people who come and say, if that happens, you should the family should just sue. You know, sue ChatGPT. But, of course, the companies will then say, hey. They're First Amendment protected. . There are people who come and say, if that happens, you should the family should just sue. You know, sue ChatGPT. But, of course, the companies will then say, hey. They're First Amendment protected. Or if not First Amendment protected, some people will say, it's section 2 30 of the Communication Decency Act, immunizes tech in general. Or maybe we're not actually, you know, the problem. The kid was already very troubled, which I'm sure is the case. And, you know, you have to blame the kid who was prompting it to do these kinds of things. So they have many defenses to this, and they will raise those defenses. You know, our view is like Mhmm. You should engineer these products where under no circumstances do they encourage a kid to jailbreak to to commit suicide. And you know what? If you're Pliny the Liberator and like a brilliant jailbreaker, maybe you can get around it on occasion. But if you're running these companies, you should expect Pliny to come and jailbreak you, and you should try to protect it against that. And, you know, they have warning flags. Right? Claude stopped me from doing lots of things. You know, Claude is so tuned. There's lots of things I ask it to do. Yeah. And Claude says, I won't do that for you. I say that Right. Encouraging a young person to commit suicide should be 1 of the things that it says, I'm just not going to help you on that project. And actually, I'm fine if it's telling an adult who wants to do that. If an adult wants to do that, I would encourage them to leave their room, go talk to some therapists, go talk to some doctors, make a much better informed decision than kinda like sitting in the darkness of their bedroom, like talking to this anthropomorphic, you know, interlocutor in in some kind of LLM, trying to decide Right. Such an important question than that. So my advice would be like, yeah, you shouldn't be out of the suicide business altogether. Something tragic happens. Some people are killed. Some innocent innocent people are killed in war, some children, you know. And now that AI is involved,…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.