← All source episodes Machine Learning Street Talk / episode intelligence
AI Is Learning at the Wrong Level of Abstraction — Matthieu Wyart
10 Aug 2026 17 published claims 2 attributable people
Speakers in the public record
Claim mix
evaluation 7belief 4prediction 3commitment 2preference 1
Evidence policy
Every row below preserves an exact excerpt. Identified speakers are linked; unresolved voices are labeled and excluded from people counts.
Claim ledger
The useful parts, with receipts.
17 published records
“We make prediction and we test them. So we predict how many data you need to learn how many different level of abstraction.”
- Publisher
- Machine Learning Street Talk
“I think you're leaning towards there being some kind of a universal learning algorithm.”
- Publisher
- Machine Learning Street Talk
“I think I'm just trying to understand what the gap is because it would be consistent with your argument.”
- Publisher
- Machine Learning Street Talk
“I will use this term in a very narrow sense of being able to generate new sentences that satisfy hard constraint syntactic rules that the child would never have heard before.”
- Publisher
- Machine Learning Street Talk
“What we argue is very important to look at and that we could finally measure with LLMs or other architecture and we find consistent result is what is the entropy left after a sentence of N token.”
- Publisher
- Machine Learning Street Talk
“I think maybe we need to do more introspection of how we function as scientists to come up with a good data set and the good procedures to teach machines to be good scientists.”
- Publisher
- Machine Learning Street Talk
“Are we doing the wrong thing? And I'm very interested in, you know, should we predict in token space at a very low level or more should we train machine to predict abstractions.”
- Publisher
- Machine Learning Street Talk
“similar context around them. And this is very pertinent because you've got a paper out basically saying that we should predict in the latent space, not the token space.”
- Publisher
- Machine Learning Street Talk
“The reason why deep architecture cancels those tasks is precisely because they understand just like the physicists understood about pressure, velocity, field.”
- Publisher
- Machine Learning Street Talk
“It doesn't mean that what he inferred is incorrect. It's not because I think an argument is incorrect that the statement is incorrect.”
- Publisher
- Machine Learning Street Talk
“Just to kind of play that back just so that everyone The idea is that there is I mean, we're talking about grammar here. But more broadly, we think that there are structured generative processes in the world.”
- Publisher
- Machine Learning Street Talk
“I mean the only way you will extrapolate and have power to generalize is if you bring those points together, it means you have an exponentially larger number of data, you have more data than atoms in the universe.”
- Publisher
- Machine Learning Street Talk
“My take is that those are more academic problems that you never encountered in in practice because sentences that loop for 50 times are extremely rare.”
- Publisher
- Machine Learning Street Talk
“I mean, certainly they are interacting with the world because those theories theories in physics are super useful to build technology.”
- Publisher
- Machine Learning Street Talk
“I will still say a word of caution that those LLMs are generative models that's very important for them to be because you can interact with them and they produce reasoning and so on.”
- Publisher
- Machine Learning Street Talk
“Okay. So I think we will be talking about creativity and then I will also be discussing a lot about constraint, but there will be in my way of thinking in another space.”
- Publisher
- Machine Learning Street Talk
“I think the analogy I like is industrial revolution when actually heat engine emerged before.”
- Publisher
- Machine Learning Street Talk