Varun Mohan: evaluation

Transcript context

…I wanna highlight when you say high intensive, you mean basically generate models every key, uh, generate inferences on every keystroke? That's right. Yeah. So I would say like, there's probably two kinds of L l M applications here. There's an L L M application where, you know, it rips through a bunch of data and maybe you wait a couple minutes and then you see something, and then there's an application where the quality is not exactly what you want, but it's able to generate enough, sorry, low enough latency. It's still providing a ton of value. And I will say there's like a gap there where the number of products that have hit that co-pilot spot is actually not that high. Mm. A lot of them are, are kind of like weight and, you know, just generate a lot of stuff and see what happens because one is clearly more compute intensive than the other Basically. Well co uh, I don't know if we told the whole story yet, you were going to…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.