Ilia Shumailov: prediction

Transcript context

…Big models today, if we compare them to the big models 5 years ago, they fail in very different ways. They get significantly better at following instructions. When they follow instructions and they become better at following instructions, you can suddenly do a lot more. So it's very easy to model an average case, it's very hard to model non average case. The worst case, which is the goal of security. Right? Exactly. Yes. Modern computers are very much just, know, a piece of magic where this chip works, you you know, you you move it there very so slightly, it becomes unstable, and then nobody knows what's happening. Agents are very different from humans, so let's like, let's take this as a stance. Right? You will not find a single human in the world that works 24 7, touches absolutely every single 1 of your endpoint in in your system that absolutely knows everything there is, like, that can generate you basically all of the hacking tools on on a whim, like, just because it knows, it has seen all of them, it can recreate this in a matter of a second. A normal human adversity when I'm an enterprise and I think, this may be an insider from, like, a from a competitor. The way they work is drastically different. They make an assumption, you as a user, you can't write, you know, 10,000 lines of hacking tools in in a day. This is not something you will be able to do. In security, we tend to say that a child is the worst case adversity you can find. Completely irrational thinking, infinite amount of time, they can basically touch everything, like, they expect there are no expectations on behaviors whatsoever. But so agents are, like, even worse than that. MLST is supported by CyberFund. Link in the description.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.