High Signal Podcasts Evidence ledger
Method
Browse
How the evidence works

Public evidence record

Ali Behrouz

Published podcast speaker

Claims
15
Episodes
1
Shows
1
Named items
0

Claim ledger

What Ali said.

2 transcript-backed records

01 / observation

We want to perform recall and in context recall task. But the point is we have some noise in the tokens and now when we have that noise in the tokens, somehow the power of Transformers that I explained in the previous setup which is which was pure in context learning.

“We want to perform recall and in context recall task. But the point is we have some noise in the tokens and now when we have that noise in the tokens, somehow the power of Transformers that I explained in the previous setup which is which was pure in context learning.”
Speaker
Ali Behrouz
Publisher
The Cognitive Revolution

02 / observation

The you know, the model can you know the first MLP block can forget something. But the point is if that specific data sample or that specific skill that is forgotten is important, then this can come back to the other MLP blocks which has not been updated so far and they have still they have the knowledge about that specific skill or data sample.

“The you know, the model can you know the first MLP block can forget something. But the point is if that specific data sample or that specific skill that is forgotten is important, then this can come back to the other MLP blocks which has not been updated so far and they have still they have the knowledge about that specific skill or data sample.”
Speaker
Ali Behrouz
Publisher
The Cognitive Revolution
Search evidence