Public evidence record
Published podcast speaker
Claim ledger
13 transcript-backed records
01 / evaluation
“We make prediction and we test them. So we predict how many data you need to learn how many different level of abstraction.”
02 / commitment
“I will use this term in a very narrow sense of being able to generate new sentences that satisfy hard constraint syntactic rules that the child would never have heard before.”
03 / belief
“What we argue is very important to look at and that we could finally measure with LLMs or other architecture and we find consistent result is what is the entropy left after a sentence of N token.”
04 / belief
“I think maybe we need to do more introspection of how we function as scientists to come up with a good data set and the good procedures to teach machines to be good scientists.”
05 / prediction
“Are we doing the wrong thing? And I'm very interested in, you know, should we predict in token space at a very low level or more should we train machine to predict abstractions.”
06 / evaluation
“The reason why deep architecture cancels those tasks is precisely because they understand just like the physicists understood about pressure, velocity, field.”
07 / evaluation
“It doesn't mean that what he inferred is incorrect. It's not because I think an argument is incorrect that the statement is incorrect.”
08 / prediction
“I mean the only way you will extrapolate and have power to generalize is if you bring those points together, it means you have an exponentially larger number of data, you have more data than atoms in the universe.”
09 / evaluation
“My take is that those are more academic problems that you never encountered in in practice because sentences that loop for 50 times are extremely rare.”
10 / evaluation
“I mean, certainly they are interacting with the world because those theories theories in physics are super useful to build technology.”
11 / evaluation
“I will still say a word of caution that those LLMs are generative models that's very important for them to be because you can interact with them and they produce reasoning and so on.”
12 / commitment
“Okay. So I think we will be talking about creativity and then I will also be discussing a lot about constraint, but there will be in my way of thinking in another space.”
13 / preference
“I think the analogy I like is industrial revolution when actually heat engine emerged before.”