Speaker unverified: uncertainty

Transcript context

…Absolutely. By the way, hot off the press. Did you hear that Elon released Grok 4? Yeah. Don't know. Don't know who's released it, but Greg, you know, from Archeprise, he posted this morning. Yeah. Greg Greg's a good guy. And apparently, it's scored about 16%, which is sorter. Even considering my friends at twofer, you know, like Mohammed and Jack. I think they're around 15.5% at the moment. So yeah, Grokfur is now in the lead. I mean, how do you interpret that? Did you think it's just sort of like dint of memorization or? I don't know. I mean I'll have to interact with it, right? Maybe it'll be really impressive. Maybe it'll But I suppose the proof's in the pudding. Like if this starts to do a bunch of really useful jobs across the economy, then we can say with certainty that we're closer to it. But these benchmarks, even like and the Arc AGI benchmark is a great benchmark, I've been looking at that my whole PhD. It's great. But it's not perfect. None of and even Gillette would not claim it to be perfect. And 16% is a great result. But I want to see if it can add long numbers. That'd probably That would be a good start.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.