Tim Scarfe: evaluation

Transcript context

…understands this. Yeah. And, you know, so he's always said that it it's it's about this kind of mimetic sharing of cognitive models about the domain and how we refine it together. On the sharing thing, this is another big scaling problem with Gen AI coding, right? So the ideal case, I've done this. I know a domain really well and I can specify it with exquisite detail and I tell Claude code, go and do this thing and the models in my mind doesn't matter. And then you go into an organization and now I need to share like my knowledge with all of the other people, right? And I'm sure you have this in your company as well. You need to that that this knowledge acquisition bottleneck is a real serious problem in in organizations. So when it's just me, I I think I'm probably about 50 times more productive using Claude Code. It's absolutely magic. And I can see why people are so excited about it. But people don't seem to understand the bottleneck and and how that doesn't really translate to many real world organizations. No one's actually creating 50 times more high quality software than they were before. So we've actually just done a study of this, and there's a tiny uptick, tiny uptick in what people are actually shipping. That's the facts. Obviously, I'm an enthusiast of AI and what it can do. But also, my wife Rachel recently pointed out in an article, all of the pieces that make gambling addictive are present in…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.