Gary Marcus: belief

Transcript context

…Great. So I'll list a bunch of bullet points of things we could discuss, and then hopefully we can get through them each. And if we miss some, well, least I put them out. So in reverse order, 10 to the 45 scenario where you just sort of brute force evolve intelligence, indeed, you would not understand how it works at all. But nevertheless, you would have it. And you could sort of take those evolved creatures out of their simulated environment and then start, you know, plugging them into, like, chat products and stuff and using them in your economy. And they would be smart. You know, they evolved their they built their own civilization in there, you know, so so they're pretty smart and they're pretty good at generalizing and so forth. So you wouldn't understand how it works, but you'd still nevertheless have the AI system. And then and indeed, that's kind of what I think is happening today for us. Like, we don't understand how these AI systems work very well. We're sort of just throwing giant blobs of compute at giant data sets and training environments and then toying out or playing around with them afterwards and seeing what they're good at. You know? But That's part of my darkness about it is I think there's too much alchemy and not enough principles. 100%. And this is and this is part of why the, like, alignment issue feels so looming to me, is that we don't even know what we're doing. How are we supposed to craft a mind that has the right virtues and the right principles and so forth when we don't even right. Anyhow, so there's that. Next thing, so you mentioned Tower Of Hanoi, math problems, these sort of ways in which the current AI systems seem limited, in particular Fragile. And fragile and hallucinations in ways that you think that we're not really making progress on. So there I would say, well, I also can't solve the Tower Of Hanoi. And I also can't do large math problems in my head. I need cools. I need to be able to program a little bit. You just I'm going to come…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.