observation · 7 Mar 2024 · 1:09:48

Random sequences of characters in a prompt can cause the system to produce completely different answers, effectively jailbreaking it.

you put essentially a random sequence of characters in a prompt and that's enough to kind of throw the system into a mode where it's gonna answer something completely different than it would have answered without this

Watch at 1:09:48