Andrew Dudzik: observation

Transcript context

…Language models cannot do addition. Not really. I keep seeing claims that they can and every time I see this claim I go again to ChatGPT and so on and check and they can't. And, what they can do is learn patterns which work a lot of the time but you can always trip them up by doing something like, okay. So if you ask chat GPT, what is a bunch of eights plus a bunch of ones with a 2 at the end? It will get the correct answer because it will recognize the trick. It'll say, ah, that's just 1 and a bunch of zeros. It'll know that you're trying to trick it. But if now you change 1 of the eights to a 7, now it has to actually know what it's doing. It has to actually sort of walk up, hit the 7, and stop sort of propagating zeros, and it simply fails. It, it either chokes and makes up some nonsense, or it says it's 1 with a bunch of zeros anyway. Like, it definitely can't add in the in the the basic way that that we know how to do algorithmically that humans learn. And so, like, really teasing apart on a very basic level, like Newton's 3 laws of motion, has it encapsulated it, Whether that's Vio or Genie, have these models encapsulated the physics of that a 100% accurately? And right now, they're not. They're kind of approximations, and they look realistic when you just casually look at them. They're not accurate enough yet to rely on, for say, robotics.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.