Ali Behrouz: evaluation

Transcript context

…And how about knowledge transfer? How should we think about the way in which? And I guess one one of the quick interjection question there too. There are still like skip connections everything. Everything is similar. Yes, exactly one, you know one, one thing that we try to do in this and learning I mean unfortunately it caused some misunderstanding about what we are doing. And you know I have received I have seen some comments about for example some of the concepts here are already new and something like that. But the point is we try to actually included all those concepts that we already knew to show that it is a universal learning paradigm. It's not something that contradicts with our current understanding. It just complements and completes what we already know about like in in a new direction. For example you can or when you are doing deep learning any form of deep learning and you are saying that I'm using this attention here you are actually using nested learning. But in deep learning you only see the final solution of each learning problem. So you have a learning problem inside the attention and you are trying to solve a regression problem and the non parametric solution to that regression problem is attention. When you see everything from deep learning side you can only see the final solution for each component. But you when you see everything from the nested learning side, you can see the internal a learning process of each component as well. So in general, it's not something that is that that contradicts what we already know, but it's somehow complements all of the things that we knew and go beyond that. I think that's generally an important part. So yeah, everything can be very similar. You can have a stipulation. Yeah. So then help us understand how we should think about the roles that the different frequency ML PS are playing knowledge transfers. One way to think about that or another way to frame the question might be how do they complement one another? How do they work together? How does the one that, and I, I would be interested to understand this both intuitively and like mechanistically to the degree you have like mechanistic understanding. But you know, how does the one that's updating fast gradually inform the ones that are updating slow? How do the ones that are updating slow kind of steer the ones that are being fast in the right directions? How how would, how do you think about the interplay between those different components? Yeah, I, I.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.