Speaker unverified: belief

Transcript context

…Another harness idea getting attention is the advisor or router model, a cheaper model that notices when it's stuck and calls up a smarter one. We asked Swix what he makes of it. This problem extends back to any problem of model routing. Like you're effectively just doing model routing, you're just giving it a different name. So like even like Not Diamond or like one of the other model routing companies out there, Martian. And then like the sort of SG Lang group at Berkeley also came up with some similar ideas before. The other things I'll also mention is that actually Walden is one of the co-founders of Cognition, had this early on and they called it Smart Friend. They released it in Windsurf. Not that many people use Windsurf, they don't talk about it. I mean, it's still like over 100,000 people, you know, but like I think the interesting thing about the advisor strategy is that it is probably the right call as the next level upgrade from using the base cheap model. But it will still not have the level of intelligence. Like you can still bench max a lot. And I think it can be like very efficient as far as like using the base model, the base cheap model as a model router. But basically the dumb model doesn't know what the smart model can do. It just knows the rough shape of what the smart model can do. So like you actually need the smart model to be able to answer what the smart model can do. And so like when you are asked a question that is more complex than you have the intelligence to answer, you don't even know. Like you're just going to straightforward answer it without knowing that like, oh, I'm supposed to call it to the smart model. And like that's just like the theoretical like limitation. But in practice, I was thinking about this three years ago, and I didn't do this because of this argument that actually you need smart model 1st, and then you can delegate to the dumb model. But in practice, for cost reasons, for efficiency reasons, you actually want to do it the other way around. You want to start with dumb model, and then you go smart as a tool call. It just isn't as satisfying. It doesn't solve anything. Is everyone using it in production? No. Will it be a trend? maybe for three months. Then you get the next clod with more adaptive routing and you're good. Like, have one model, train it end to end for adaptive thinking and you're probably more better judged there than a systems level thing. We turn to continual learning, whether AI systems can really learn and remember on the job, not just look things up.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.