Nathan Labenz: belief

Transcript context

…I have a feeling what what I'm describing is is is is a step towards machine learning, but it's not it's not the final step. I think the the final step I think I think, like, the the bitter lesson will have you, like, inference and training need to be one and the same. Like, we can't separate them. You know? That's that's sort of what I think the entire field is looking for right now. I agree. Once we get there, it's going to be crazy and scary and very, very, very different. But, yeah, I think I think we all bring the LoRa thing I just mentioned, like, look. It's it's an engineering problem. You know? You can figure it out, especially now that we have a GI. So it's yeah. I think I think I think the the LoRa thing is going to happen soon in the next six months. I think even, like, one of their Frontier labs is may do it. I thought that was honestly one of the things that OpenAI did extremely well with their fine tuning product. They were clearly doing something like this because they would allow you to do the fine tune, then you'd have the same rate limits with your fine tuned model as you had with the base models. And I was always really impressed by that engineering accomplishment. And now it does surprise me that they've gone away from it so much, but I also agree with your guidance. I would definitely tell people don't rush into fine tuning these days. It's a slow cycle, and that you could probably get what you need for less total effort available models that you don't have to monkey around with in that way. 100%. So you talked about scary stuff, which is maybe a good transition to kind of not second half because we've been at it for a while, but a second phase of this conversation around just zooming out and looking at the super big AI picture. Maybe I'll let you choose the order of topics when it comes to Chinese models and what if anything should be done about them because you did recently post something, I think, quite counterintuitive given the fact that you're running your company on deep seek. I'll let you state your position there. But Yeah. Should that come before or after the big picture, where are we in this kind of, oh my god, we just had open face happen. Thanks. What does it mean, and what should be done about it? Yeah. I'm trying to coin that. We'll see if it sticks.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.