Raza Habib: belief

Transcript context

…all in cost 500 million. So let's say it was 500 million today, and it became 1 million or 2 million. Yeah, yeah. That becomes accessible to... So, you know, even startups, let alone, you know, medium sized companies. And I think we should assume something like that will happen. I would say even without significant research breakthroughs on the modeling side, I would just expect inference costs to become a lot cheaper. So training is difficult to optimize from a research perspective, but figuring out how to quantize models, how to make hardware more efficient, that to me feels like you chip away at it and it'll just happen naturally. And we're already seeing signs of that. Yeah. So I would expect inference to get phenomenally cheaper, which is most of the cost. Yeah, and a previous guest that we had on by the time this comes out is Chris Lattner who is working on Compilation for Python that that's going to make inference a lot cheaper because it's going to fully saturate the actual compute that we already have. Yeah…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.