Thomas Ahle: belief

Transcript context

…So as I understand correctly, so similarly to Anthropic, Carlini had this blog post out and they had a functional specification of a C compiler and they had 40,000 agents, and they reproduced the C compiler. You did a similar thing for an E-forty 2. By the way, right? Well, that's an interesting thing as well. Because this is what I want to get to, right? It's tantalizing. That that there there are there are some domains that are so well evolved that we have, you know, that might be very complex, but but we have a functional specification, and and it's reasonably coherent. So so the idea is we we get a shitload of agents, and we reproduce the function of this software based on these tests, we do it recursively, agentically, and and and so on. Now, my my contention with this is I think that it's not about where you end up. It's not about the functions and the tests passing. It's about how you got there and how structured it is. Yeah. So there is this tendency with agentic coding to build a spaghetti monster, which seems to work. But because if you think about it in in this project you're talking about, I think you said there's, 500 or more, 500,000 lines of code. And in 5 years' time, there's all of this code that probably, you know, you folks haven't read most of it. What you know, that that that sounds like a problem. Yeah. I think for a lot of this stuff, we're relying on the hope of some kind of escape velocity from code complexity that the models are gonna keep improving faster than our code gets messed up. I had those 3 days of you know fable access and it was really good like it definitely cleaned up a few things that GBT55 had messed up. But but but did it though? Do you think it could be deceptive? Because you know when when Fable comes out, all of a sudden 4.8 looks terrible, and when 4.8 came out, it looked amazing compared to, you know, 4 4.6. So so it it there's something deceptive about it, bit, you know, it's like a parlor trick.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.