Nathan Labenz: belief

Transcript context

…It's interesting, I think a lot of companies feel that they have a vast amount of data, but when you compare it to the size of of the web, which is what these frontier models are trained on, they're trained on the web plus, let's say all the books in the world, etcetera. Then the extra corporate data is, is small. So how do you incorporate it and weigh it correctly? If you do just the corporate data, you won't know anything about calculus, let's say, you know, so that would be a problem for some, for some companies. So, so then people imagine adding, you know, the the web plus their data that gets very expensive. You can see, you know, the deep seq models, you know, say it was 5 million to train, but actually they very much admit that maybe it was another 5 million to finish. And these are by extreme experts, which enterprises, you know, don't, don't have. And so I think that, yeah, our thought was that, you know, search is a good bridge between all of the corporate information and a model because models are good enough to know how to incorporate new information that's relevant to to the actual query being asked and can be able to fetch more information to create, you know, that answer or that research report. But if you think about finishing a model with corporate data, there's another phenomenon called catastrophic forgetting, that as you add information at the end, after a model's trained and released, then if you add too much new information, then it kind of forgets some of the things that it really needed to remember. So I think, you know, there's a number of smart people working on that problem. And don't worry, you won't be able to miss it if people, please, people, do solve that problem. You'll read about it everywhere. I think one of the interesting questions is I think the Uber CTO came out and said that they busted through their clawed budget, you know, for the year in the first four months. Do you think having cheaper search will help these enterprises reduce, you know, token token costs? Absolutely. So if you go to, if you're the Uber CTO or maybe the CFO, if you go to your admin panel, you can just add the ceramic connector and then say for a prompt, ceramic is almost free, use ceramic first. And and really, if for some reason we don't cover a topic, then it actually defaults to the default search. But that right there would save a lot of overage charges for a number of enterprises.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.