Speaker unverified: belief

Transcript context

…And sure, you had December 19, 2022. You have one of our guests post what building Copilot for X really takes. Estimate inference to figure out latency quality. Build first party instead of using third party as ABI. Okay. Figure out real time because chat GBT and DALI DALI at the RFP are too slow. Optimize prompt because context window is limited, which is maybe not that true anymore. And then merge model outputs with the UX to make the product more intuitive. Is there anything you would add? I'd give myself like a B minus on that. Some parts of that are accurate. Even like the context like the one that you called out. Yeah, models have larger context links now. That's absolutely true. It's grown a lot. But look at an enterprise code base. They have tens of millions of lines of code that's hundreds of billions of tokens. Never going to change. Still being really good at being able to piece together this distributed knowledge is important. So I think there are figures there that I think are still pretty accurate. There's probably some that are less so. First party versus third party. I think we're wrong there. I think I would nuance that to be like, there are certain things that it's really important to first party. Like autocomplete. You have a really specific application that you can't just prompt engineer your way out of or just maybe even fine tune afterwards. You just can't do that. I think there's truth there. But let's also be realistic. The stuff that's coming out for the third model providers like Cascade and Windsurf would not have been possible if it wasn't for the rapid improvements with 4.0 and 3.5. That just wouldn't have been possible. So I'll give myself a B minus. I'll say I passed. But yeah, it's two hours and two years later. Just to be clear, we're not grading. It's more of a what would you, you know, where are they now? What would you have added? What would you like? Yeah, I mean,…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.