tool / uses
MATLAB
“during my PhD, I used Mathematica and MATLAB”
Public evidence record
Tim Scarfe
Host · Machine Learning Street Talk
- Claims
- 168
- Episodes
- 35
- Shows
- 1
- Named items
- 4
Books, apps, and tools
The evidenced stack.
tool / uses
Mathematica
“during my PhD, I used Mathematica and MATLAB”
person / likes
Douglas Hofstadter
“Yes. I I love Douglas Hofstadter. So so there's this kind of self modeling and then second order self modeling and third order self modeling which could be applied to other agents and of course, know, in in the real world, we are computationally bounded.”
person / likes
Andy
“I'm I'm huge fan of Andy's, big hero of mine. You probably didn't think that they would be so relevant later on in your career.”
Claim ledger
What Tim said.
16 transcript-backed records
01 / prediction
Just to kind of play that back just so that everyone The idea is that there is I mean, we're talking about grammar here. But more broadly, we think that there are structured generative processes in the world.
“Just to kind of play that back just so that everyone The idea is that there is I mean, we're talking about grammar here. But more broadly, we think that there are structured generative processes in the world.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
02 / prediction
For the 1st time now everyone's thinking about sovereign AI, because you talk about loss of control, but right now, these models are agency promoting.
“For the 1st time now everyone's thinking about sovereign AI, because you talk about loss of control, but right now, these models are agency promoting.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
03 / prediction
I think in this world, we can still use intelligence and we can still like acquire abstractions and descriptions for these high level phenomena.
“I think in this world, we can still use intelligence and we can still like acquire abstractions and descriptions for these high level phenomena.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
04 / prediction
Because there is some kind of a combinational closure, and that means from the primitives in an LLM, can do hill climbing, and we can build some computational structure to solve problems.
“Because there is some kind of a combinational closure, and that means from the primitives in an LLM, can do hill climbing, and we can build some computational structure to solve problems.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
05 / prediction
There are now structural biologists around the world that can innovate and build new products and save lives potentially because they have access to this protein database.
“There are now structural biologists around the world that can innovate and build new products and save lives potentially because they have access to this protein database.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
06 / prediction
Yeah. And what the researchers found is that you train this big dense neural network, and after it's trained, because you need the density for stochastic gradient descent for training tractability, after it's trained, you can prune away 90% of the connections and it still works the same And, maybe evolution and our biological instantiation, maybe it's the same thing.
“Yeah. And what the researchers found is that you train this big dense neural network, and after it's trained, because you need the density for stochastic gradient descent for training tractability, after it's trained, you can prune away 90% of the connections and it still works the same And, maybe evolution and our biological instantiation, maybe it's the same thing.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
07 / prediction
You start feeling the AGI and you'd be forgiven for thinking this because I've been using Claude code and my god, I feel that there's been more interesting stuff happening in the world of software development in the last 6 months than there has been in the previous 20 years.
“You start feeling the AGI and you'd be forgiven for thinking this because I've been using Claude code and my god, I feel that there's been more interesting stuff happening in the world of software development in the last 6 months than there has been in the previous 20 years.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
08 / prediction
They're getting, know, the 10 times bigger every few years and the the bullish people say, oh, we're on an exponential curve and it's just gonna keep going up. But I think that because there is so much groupthink and it's fundamentally the same technology and the same people and there's no fresh new ideas that in a sense it's converged and it's not disruptive anymore.
“They're getting, know, the 10 times bigger every few years and the the bullish people say, oh, we're on an exponential curve and it's just gonna keep going up. But I think that because there is so much groupthink and it's fundamentally the same technology and the same people and there's no fresh new ideas that in a sense it's converged and it's not disruptive anymore.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
09 / prediction
Exactly. And and this is the reason why in my opinion LLMs are not intelligent because they don't have this coarse grained dynamic adaptation of their architecture.
“Exactly. And and this is the reason why in my opinion LLMs are not intelligent because they don't have this coarse grained dynamic adaptation of their architecture.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
10 / prediction
So we want to have understanding which carves the world up by the joints, which represents the important invariances in the world. And the thesis is, I think, that compression might be necessary for understanding.
“So we want to have understanding which carves the world up by the joints, which represents the important invariances in the world. And the thesis is, I think, that compression might be necessary for understanding.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
11 / prediction
You know, if we had perfect verifiers and and synthetic data generators, probably we wouldn't even need LLMs in the first place, right, because we've already solved all the problems.
“You know, if we had perfect verifiers and and synthetic data generators, probably we wouldn't even need LLMs in the first place, right, because we've already solved all the problems.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
12 / prediction
Because I think at some point here soon, I don't know when, next year, 5 years, whatever, personalized, you know, AI models are gonna be a big thing.
“Because I think at some point here soon, I don't know when, next year, 5 years, whatever, personalized, you know, AI models are gonna be a big thing.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
13 / prediction
It's it's Turing complete. And our brains, even though they are finite, they run a Turing complete algorithm, which means our brains know how to expand their memory.
“It's it's Turing complete. And our brains, even though they are finite, they run a Turing complete algorithm, which means our brains know how to expand their memory.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
14 / prediction
I guess, in a way, I can't challenge you because you're already saying they need to be biological and and like, you know, physical and real and so because I mean, my my obvious retort to that would be, well, a computer simulation of those things obviously wouldn't be conscious.
“I guess, in a way, I can't challenge you because you're already saying they need to be biological and and like, you know, physical and real and so because I mean, my my obvious retort to that would be, well, a computer simulation of those things obviously wouldn't be conscious.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
15 / prediction
Yeah. And and if I understand correctly, I I think that I've spent years since I read that 2007 paper, but but it it it was about an agent minimizing common complexity, which can, like, do well on a on a the the expected performance on a wide range of environments.
“Yeah. And and if I understand correctly, I I think that I've spent years since I read that 2007 paper, but but it it it was about an agent minimizing common complexity, which can, like, do well on a on a the the expected performance on a wide range of environments.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk
16 / prediction
It's a divergent, unpredictable, open ended search into the unknown. It's possible that the most important discoveries that we will eventually make will be the ones we aren't even looking for now.
“It's a divergent, unpredictable, open ended search into the unknown. It's possible that the most important discoveries that we will eventually make will be the ones we aren't even looking for now.”
- Speaker
- Tim Scarfe
- Publisher
- Machine Learning Street Talk