Alessio Fanelli: uncertainty

Transcript context

…So as someone who... This is the web developer coming out. As someone who is a champion of the open web, Apple has been, let's just say, roadblock in that direction. I think Gemini Nano being good is more important than Apple Intelligence being generally capable. Apple Intelligence being on-device router for Apple apps is good. But if you care about the open web, you really need Gemini Nano to work. And we're not sure. Right now we have some demos showing that it's fast enough, but we haven't had systematic tests on it. Along the lines of that research, I will highlight that Apple has also put out Datacomp LM. I actually interviewed Datacomp at NeurIPS last year. And they've branched out from just vision and images to language models. And Apple has put out a reference implementation of the 7B language model that's built on top of Datacomp. And it is better than FindWeb, which is huge. Because FindWeb was the state-of-the-art last month. And that's fantastic. So basically, Datacomp is an open data, open weights, open model. It's super everything open. So there will be a lot of people optimizing this kind of model. They will be building on architectures like Mobile LM and Small LM, which basically innovate in terms of shared weights and shared matrices for small models so that you just optimize the amount of file size and memory that you take up. And I think just general trend on device models, the only way that intelligence too cheap to meter happens is everything happens on device. So unfortunately, that means that OpenAI is not involved in this. OpenAI's mission is intelligence too cheap to meter. And they're not doing the one thing that needs to happen for that because there's no business plan in monetizing an API for that. By definition, none of this is APIs. I don't know. I guess Johnny Ive and Sam Altman need to figure it out so they can do their own device. Yeah. I'm excited for OpenAI phone. I don't know if you would buy an OpenAI phone. I mean, I'm very locked into the iOS ecosystem.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.