book / built
The Algebraic Mind
“I see a set of problems that a cognitive creature must solve, many of which I wrote in my 2,001 book, The Algebraic Mind.”
Public evidence record
Gary Marcus
Published podcast speaker
- Claims
- 39
- Episodes
- 1
- Shows
- 1
- Named items
- 2
Books, apps, and tools
The evidenced stack.
book / built
The Future of the Brain
“And it was in a book that I wrote called The Future of the Brain, which I guess we wrote in 02/2015.”
Claim ledger
What Gary said.
22 transcript-backed records
01 / belief
Think that's exactly what people like Sam and Dario are now hinting that they're gonna be able to do soon. I'm not really buying those claims, but I think that's what they wanna do now.
“Think that's exactly what people like Sam and Dario are now hinting that they're gonna be able to do soon. I'm not really buying those claims, but I think that's what they wanna do now.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
02 / belief
I hadn't played this variation either before, but it was obvious what to do. So it failed to identify what 3 in a row was, which I would say goes to a conceptual weakness like you should have had enough data to understand what 3 in a row was.
“I hadn't played this variation either before, but it was obvious what to do. So it failed to identify what 3 in a row was, which I would say goes to a conceptual weakness like you should have had enough data to understand what 3 in a row was.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
03 / belief
I think your forecasts don't make a lot of contact with the kind of stuff that the 2 of us just talked about.
“I think your forecasts don't make a lot of contact with the kind of stuff that the 2 of us just talked about.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
04 / belief
I agree. So, Amy, we can agree that, like, voluntary self regulation is probably not enough to get to that point.
“I agree. So, Amy, we can agree that, like, voluntary self regulation is probably not enough to get to that point.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
05 / belief
Read I think more people probably read the, darker scenario than the positive scenario.
“Read I think more people probably read the, darker scenario than the positive scenario.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
06 / belief
I mean, here's way to put it, is the AGI that I think we're afraid might be unconstrained or whatever, there really shouldn't be a lot of edge cases like that.
“I mean, here's way to put it, is the AGI that I think we're afraid might be unconstrained or whatever, there really shouldn't be a lot of edge cases like that.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
07 / belief
I think we are completely agreed that we're not doing a great job on the alignment problem and that we need to do much better and that there's a temporal dimension to that as you were just saying, which is like, you know, it's not great for humanity if we solve that problem in 200 years and we we have AGI or ASI, you know, in the next decade or 2.
“I think we are completely agreed that we're not doing a great job on the alignment problem and that we need to do much better and that there's a temporal dimension to that as you were just saying, which is like, you know, it's not great for humanity if we solve that problem in 200 years and we we have AGI or ASI, you know, in the next decade or 2.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
08 / belief
Was going say the last thing, which is I first noted the problem with chess I think 2 years ago, the illegal move problem.
“Was going say the last thing, which is I first noted the problem with chess I think 2 years ago, the illegal move problem.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
09 / belief
There's some differentiation in how people do their RL and what their data sets are, but I think there's not so much value in transparency until somebody has something that really is unique that they think other people aren't going to just reconstruct very rapidly.
“There's some differentiation in how people do their RL and what their data sets are, but I think there's not so much value in transparency until somebody has something that really is unique that they think other people aren't going to just reconstruct very rapidly.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
10 / belief
I I think that that requires an understanding of the problem, what humans want solved by the problem.
“I I think that that requires an understanding of the problem, what humans want solved by the problem.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
11 / belief
I I think distribute I'll put it this way. There'll be many, many examples I can come up with distribution shift.
“I I think distribute I'll put it this way. There'll be many, many examples I can come up with distribution shift.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
12 / belief
I know they've been trained on Wikipedia. They've probably read like Bobby Fischer played chess, which is how I learned to play chess.
“I know they've been trained on Wikipedia. They've probably read like Bobby Fischer played chess, which is how I learned to play chess.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
13 / belief
If you can have the neural networks reliably call the tools that they want or that they should be calling relative to the problem, I should say, then you're golden. I think empirically it is a bit hard to get the tools to work reliably.
“If you can have the neural networks reliably call the tools that they want or that they should be calling relative to the problem, I should say, then you're golden. I think empirically it is a bit hard to get the tools to work reliably.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
14 / belief
I mean, I think someone could come up with a scheme to get LLMs to to play chess without making illegal moves by calling a tool.
“I mean, I think someone could come up with a scheme to get LLMs to to play chess without making illegal moves by calling a tool.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
15 / belief
I think the 3 of us are maybe not known for agreeing on everything, but we actually have a lot of shared values around that, and I'm looking forward to the conversation.
“I think the 3 of us are maybe not known for agreeing on everything, but we actually have a lot of shared values around that, and I'm looking forward to the conversation.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
16 / belief
I think that the level of intelligence that you attribute to the machines towards the end of the essay I remember some of that actually happens after the year 2027.
“I think that the level of intelligence that you attribute to the machines towards the end of the essay I remember some of that actually happens after the year 2027.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
17 / belief
You know? But That's part of my darkness about it is I think there's too much alchemy and not enough principles.
“You know? But That's part of my darkness about it is I think there's too much alchemy and not enough principles.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
18 / belief
Like in the very fastest case, it'd be 2,030. It would require solving multiple problems that I think we're just not positioned quite yet.
“Like in the very fastest case, it'd be 2,030. It would require solving multiple problems that I think we're just not positioned quite yet.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
19 / belief
You can argue about that and and, you know, I I would say that like the weakest AGI would be it's as good as Joe Sixpack who's really not very good at reasoning, has is full of confirmation bias, has not gone to graduate school, doesn't have, you know, critical reasoning.
“You can argue about that and and, you know, I I would say that like the weakest AGI would be it's as good as Joe Sixpack who's really not very good at reasoning, has is full of confirmation bias, has not gone to graduate school, doesn't have, you know, critical reasoning.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
20 / belief
Like I believe in my political party and so when my political party does dumb thing then I go and try to, you know, come up with a rationale for it.
“Like I believe in my political party and so when my political party does dumb thing then I go and try to, you know, come up with a rationale for it.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
21 / belief
I think the notion of a durable advantage in LLMs, if that's what the technology is, is a myth.
“I think the notion of a durable advantage in LLMs, if that's what the technology is, is a myth.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk
22 / belief
I think if you rule out data contamination, the performance on problems that are new is not good.
“I think if you rule out data contamination, the performance on problems that are new is not good.”
- Speaker
- Gary Marcus
- Episode
- Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks)
- Publisher
- Machine Learning Street Talk