Vibhu Sapra: evaluation

Transcript context

…Yeah. To me, like double descent is like the biggest thing to like ML research where like, if you believe in scaling, then you don’t need, you need to know where to scale. And. But if you believe in double descent, then you don’t, you don’t believe in anything where like anything levels off, like. I mean, also tendentially there’s like, okay, when you talk about the China vector, right. There’s the subliminal learning work. It was from the anthropic fellows program where basically you can have hidden biases in a model. And as you distill down or, you know, as you train on distilled data, those biases always show up, even if like you explicitly try to not train on them. So, you know, it’s just like another use case of. Okay. If we can interpret what’s happening in post-training, you know, can we clear some of this? Can we even determine what’s there? Because yeah, it’s just like some worrying research that’s out there that shows, you know, we really don’t know what’s going on. That is. Yeah. I think that’s the biggest sentiment that we’re sort of hoping to tackle. Nobody knows what’s going on. Right. Like subliminal learning is just an insane concept when you think about it. Right. Train a model on not even the logits, literally the output text of a bunch of random numbers. And now your model loves owls. And you see behaviors like that, that are just, they defy, they defy intuition. And, and there are mathematical explanations that you can get into, but. I mean.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.