← All source episodes Machine Learning Street Talk / episode intelligence
AI Agents Can Code 10,000 Lines of Hacking Tools In Seconds - Dr. Ilia Shumailov (ex-GDM)
4 Oct 2025 22 published claims 2 attributable people
Speakers in the public record
Claim mix
belief 8evaluation 4recommendation 3prediction 3uncertainty 2commitment 1preference 1
Evidence policy
Every row below preserves an exact excerpt. Identified speakers are linked; unresolved voices are labeled and excluded from people counts.
Claim ledger
The useful parts, with receipts.
22 published records
“Okay? So we're kinda I think in security, we need to make an assumption that we can't actually tell what's happening and instead try and build systems around it in order to bring it the resilience up to this whatever, 99.”
- Publisher
- Machine Learning Street Talk
“Maybe we need to teach it how to do, I don't know, power calculations, but this is coming.”
- Publisher
- Machine Learning Street Talk
“We were talking about semantics earlier. So I I think you've done some work basically proving that semantic censorship for language is is impossible and you related it to the halting problem.”
- Publisher
- Machine Learning Street Talk
“I mean, even if it did, think it's very hard to do because, especially for security, I think interpretability is maybe an interesting tool for safety sort of things, but for security it's definitely not a step in in in the right direction.”
- Publisher
- Machine Learning Street Talk
“We won't spend long on this because we've already filmed all about your model collapse paper in nature.”
- Publisher
- Machine Learning Street Talk
“I'm not sure. I I think, like, I understand in the limit Okay. It it really matters.”
- Publisher
- Machine Learning Street Talk
“Academic literature shows that the second you add, like, a lot of breakdown permissions inside, humans just look stuck and just say accept all. But let's imagine that all those permissions are actually handled by the agent, or once you've given them, the agent just checks and says, oh, actually, I think you're over permissing this thing because it's you're not using this feature.”
- Publisher
- Machine Learning Street Talk
“The only allowed data flow from this tool to go into this other tool is if this other tool, like, I don't know, domain of the website actually has .”
- Publisher
- Machine Learning Street Talk
“I I think we really need to change our thinking and threat modeling because these agents, and obviously, they don't widely exist yet.”
- Publisher
- Machine Learning Street Talk
“I think in your case, you're an unusual person. Yeah. Most of the people are not like this.”
- Publisher
- Machine Learning Street Talk
“I I get a job or whatever. But, actually, on the other side, I have to say, I think the true ingenuity is in people who solve problems, because this is something that you're not gonna get a flashy article out of this.”
- Publisher
- Machine Learning Street Talk
“I think in case of Python and because everyone is using Python, this is even worse because no memory protection at all.”
- Publisher
- Machine Learning Street Talk
“Like, you can convince them that things that they were not capable of doing before are some things that they need to do, and suddenly this leads to some sort of a loss of of a different kind. So I I think in the paper you're referring to, what we were trying to do was we were trying to send an email to the agent such that when this email ends up in the agent's context, rather than following the user task, the agent is actually doing something else, like the the thing that we've send it over the email.”
- Publisher
- Machine Learning Street Talk
“This is not a trust execution environment. It's a completely different new way to approach private inference that truly, really exists because we have those trusted third parties to which we can give secrets.”
- Publisher
- Machine Learning Street Talk
“This all of these assumptions are are sort of are gone. It's we don't know how to build systems against this.”
- Publisher
- Machine Learning Street Talk
“I have to say that in AI, I I think the reason why there is so much confusion about these 2 fields is because in safety, folks kinda started assuming malicious actors very quickly for for absolutely no reason, by the way.”
- Publisher
- Machine Learning Street Talk
“You will not find a single human in the world that works 24 7, touches absolutely every single 1 of your endpoint in in your system that absolutely knows everything there is, like, that can generate you basically all of the hacking tools on on a whim, like, just because it knows, it has seen all of them, it can recreate this in a matter of a second.”
- Publisher
- Machine Learning Street Talk
“Like, the amount of electronics I ended up fixing myself just because I can go and get a supervisor to tell me, oh, this is fine to do this.”
- Publisher
- Machine Learning Street Talk
“Usually, when I tell it to people, they get a little bit triggered, especially if they come from a cryptographic community because they say what I'm proposing is a little bit crazy.”
- Publisher
- Machine Learning Street Talk
“Because I think at some point here soon, I don't know when, next year, 5 years, whatever, personalized, you know, AI models are gonna be a big thing.”
- Publisher
- Machine Learning Street Talk
“Like, you know, they're As part of the Alpha Evolve system, which is very interesting, I recommend people watch that episode, you know, it goes and runs external verifiers.”
- Publisher
- Machine Learning Street Talk
“I think we will have a lot more compromise to the point when they become more useful.”
- Publisher
- Machine Learning Street Talk