High Signal Podcasts Evidence ledger
Method
Browse
← All source episodes

Machine Learning Street Talk / episode intelligence

AI Is Learning at the Wrong Level of Abstraction — Matthieu Wyart

10 Aug 2026 17 published claims 2 attributable people

Speakers in the public record

Claim mix

evaluation 7belief 4prediction 3commitment 2preference 1

Evidence policy

Every row below preserves an exact excerpt. Identified speakers are linked; unresolved voices are labeled and excluded from people counts.

Claim ledger

The useful parts, with receipts.

17 published records

04 / commitment

I will use this term in a very narrow sense of being able to generate new sentences that satisfy hard constraint syntactic rules that the child would never have heard before.

“I will use this term in a very narrow sense of being able to generate new sentences that satisfy hard constraint syntactic rules that the child would never have heard before.”
Speaker
Matthieu Wyart
Publisher
Machine Learning Street Talk

05 / belief

What we argue is very important to look at and that we could finally measure with LLMs or other architecture and we find consistent result is what is the entropy left after a sentence of N token.

“What we argue is very important to look at and that we could finally measure with LLMs or other architecture and we find consistent result is what is the entropy left after a sentence of N token.”
Speaker
Matthieu Wyart
Publisher
Machine Learning Street Talk

06 / belief

I think maybe we need to do more introspection of how we function as scientists to come up with a good data set and the good procedures to teach machines to be good scientists.

“I think maybe we need to do more introspection of how we function as scientists to come up with a good data set and the good procedures to teach machines to be good scientists.”
Speaker
Matthieu Wyart
Publisher
Machine Learning Street Talk

07 / prediction

Are we doing the wrong thing? And I'm very interested in, you know, should we predict in token space at a very low level or more should we train machine to predict abstractions.

“Are we doing the wrong thing? And I'm very interested in, you know, should we predict in token space at a very low level or more should we train machine to predict abstractions.”
Speaker
Matthieu Wyart
Publisher
Machine Learning Street Talk

08 / evaluation

similar context around them. And this is very pertinent because you've got a paper out basically saying that we should predict in the latent space, not the token space.

“similar context around them. And this is very pertinent because you've got a paper out basically saying that we should predict in the latent space, not the token space.”
Speaker
Tim Scarfe
Publisher
Machine Learning Street Talk

09 / evaluation

The reason why deep architecture cancels those tasks is precisely because they understand just like the physicists understood about pressure, velocity, field.

“The reason why deep architecture cancels those tasks is precisely because they understand just like the physicists understood about pressure, velocity, field.”
Speaker
Matthieu Wyart
Publisher
Machine Learning Street Talk

11 / prediction

Just to kind of play that back just so that everyone The idea is that there is I mean, we're talking about grammar here. But more broadly, we think that there are structured generative processes in the world.

“Just to kind of play that back just so that everyone The idea is that there is I mean, we're talking about grammar here. But more broadly, we think that there are structured generative processes in the world.”
Speaker
Tim Scarfe
Publisher
Machine Learning Street Talk

12 / prediction

I mean the only way you will extrapolate and have power to generalize is if you bring those points together, it means you have an exponentially larger number of data, you have more data than atoms in the universe.

“I mean the only way you will extrapolate and have power to generalize is if you bring those points together, it means you have an exponentially larger number of data, you have more data than atoms in the universe.”
Speaker
Matthieu Wyart
Publisher
Machine Learning Street Talk

13 / evaluation

My take is that those are more academic problems that you never encountered in in practice because sentences that loop for 50 times are extremely rare.

“My take is that those are more academic problems that you never encountered in in practice because sentences that loop for 50 times are extremely rare.”
Speaker
Matthieu Wyart
Publisher
Machine Learning Street Talk

15 / evaluation

I will still say a word of caution that those LLMs are generative models that's very important for them to be because you can interact with them and they produce reasoning and so on.

“I will still say a word of caution that those LLMs are generative models that's very important for them to be because you can interact with them and they produce reasoning and so on.”
Speaker
Matthieu Wyart
Publisher
Machine Learning Street Talk

16 / commitment

Okay. So I think we will be talking about creativity and then I will also be discussing a lot about constraint, but there will be in my way of thinking in another space.

“Okay. So I think we will be talking about creativity and then I will also be discussing a lot about constraint, but there will be in my way of thinking in another space.”
Speaker
Matthieu Wyart
Publisher
Machine Learning Street Talk
Search evidence