Josep M. Pujol: preference

Transcript context

…The business side of this work for Brave. I'm just doing a little back of the envelope math, and I'm imagining, okay. Jeez. If you're doing 30,000,000 queries a day, and I don't know how much how many tokens you're putting in per query, but we can get into a little bit more specifically, like, much data is returned. But it's not as insignificant amount. It's gotta be thousands of tokens per query. It's like it's 4,000 tokens per query usually. We we usually max out our context window, which is like 4,000. But it's also it's all self hosted. We do not use any third party. And about it, not because of the independence part, which would also be because we value that we are independent, but also like cost, right? We would not be able to use OpenAI or anything like this cost wise. So everything that we do is like self hosted and we saw that we have to pay machines. I think that nobody will complain if I say that. But for instance, right now, I think that we have 28 hundreds out of Amazon. So that's our infrastructure for the PC LLM plus a lot of, like, GPUs for the smaller model of q and a's and classifiers. So it's a big infrastructure, but it's not as massive as as many people, I think. So I guess for now, it's not so expensive that it forces a business model change because this is, like, both this is something Google's obviously gonna be facing in a big way too. Right? Like, it's very unclear how even if you're doing, like, pay per click advertising within search, it's very unclear how that fits in with these AI answers. And then more broadly, like, it's just very unclear how do you guys think of, like, a subscription model in the future for something like this, or do you have any idea for how this evolves business wise?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.