Evidence receipt / recommendation
Published · transcript-backedIlia Shumailov: recommendation
4 Oct 2025 Machine Learning Street Talk AI Agents Can Code 10,000 Lines of Hacking Tools In Seconds - Dr. Ilia Shumailov (ex-GDM)
“Okay? So we're kinda I think in security, we need to make an assumption that we can't actually tell what's happening and instead try and build systems around it in order to bring it the resilience up to this whatever, 99.”
Source trail
Everything needed to verify it.
- Speaker
- Ilia Shumailov
- Attribution
- Verified speaker
- Claim type
- recommendation
- Recorded
- 4 Oct 2025
- Publisher
- Machine Learning Street Talk
Transcript context
…Oh, boy. This yeah. I was just gonna say, this actually bring back nightmares of my trading days. I used to do high frequency trading. Right? And so we're writing algorithms that are running, you know, on the fastest chips we can get, highly tuned. Every nanosecond matters. And then 1 day, you know, hey, let's upgrade to the next Intel chip. And they just had changed something about the cache coherency algorithm on the processors, which ordinarily should make no difference whatsoever. And now suddenly our algorithms are just their performance is trashed, and we have no idea why and, you know, have to investigate. It's crazy how much of it. Yeah. Yeah. Totally. I I think I wouldn't yeah. I keep on referring to the system as alchemy. Like, it's nobody knows what's happening. Something is happening. Okay? So we're kinda I think in security, we need to make an assumption that we can't actually tell what's happening and instead try and build systems around it in order to bring it the resilience up to this whatever, 99. 9999, and ideally, as many nines as possible. But, unfortunately, not a 100%. I don't think Well, maybe maybe if we can project this into kind of a a user friendly Yeah. Idea. Because I think at some point here soon, I don't know when, next year, 5 years, whatever, personalized, you know, AI models are gonna be a big thing. It's like I'm gonna want a model that provides a web chatbot interface for you to talk to me when I don't have time or something that more or less is my personality. However, I don't want it to reveal certain private information. Like, how would I even define that as a security…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.