Tim Scarfe: belief

Transcript context

…shared brain, where all of the experiences go what is called the pork or something. Yeah. Go back off and then yeah. Yeah. So, but but it's interesting to make you know, to to discuss, is that effectively the same? Like, if we actually had some hypothetical real time adaptive divergent Claude, you know, would it be much better than the Claude that we already have? And, it's also related to the to the work that you guys do, because, the process of intelligence, in my view, is the creation of these coarse grainings, skills. And that's kind of like what you guys are doing with ASICs. So you're building this customized hardware for making certain types of computation go really, really quickly. And it's almost like that's the result of intelligence. So you say, I'm gonna take a very, very complicated thing, and I'm going to whittle it down and represent it in the best way I can, and then I'm gonna bake it into a non adaptable hardware substrate. Is that fair? I think that is 1 that is what we're working on right now is this this idea of of trying to to build hardware that best fits like the models we have right now and just like really make a super efficient inference. You could say like the in the past at least the issue has been you stop yourself from innovating on the software side, but if you lock down your hardware too much, right, like the NVIDIA chips has been pretty good for innovation, like they're pretty flexible. Of course, they also have guided the way we do AI in a lot of ways like towards matrix multiplications and so on. Still people have been able to innovate. But on the other hand, I think also hardware is getting easier and easier to make with these kind of AI for EDA tools. So it's sort of shortening the like maybe now people are thinking about like making their cooler kernels, right? It's like it's not so unreasonable to think that soon we'll just be doing our AI for making like instead of CUDA kernels, we'll just like make some custom circuits for every single thing we want. So if you come up with a if you want your new algorithm to run really fast, you just design like a specialized circuit for that. And the AI helps you like optimize it and check that it's correct. Of course you still have the fab, but people are we're getting better at like batching things for the fab. I mean I also think having the really flexible hardware is gonna be very interesting, like the stuff where it's learning on chip and ideally like maybe the more adaptability…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.