High Signal Podcasts Evidence ledger
Method
Browse
← Back to evidence

Evidence receipt / belief

Published · transcript-backed

Nathan Labenz: belief

15 Jun 2024 The Cognitive Revolution Building Brave: Private Search, One AI Layer at a Time with Josep M. Pujol

“I as a power user of all of these things, I have to say I I do find myself going to different services depending on the query. It seems like I've noticed and I would say I would I think Brave is in the middle, I would say, right now between like, perplexity gives me a lot of times the shortest, most to the point answer.”

— Nathan Labenz

Source trail

Everything needed to verify it.

Speaker
Nathan Labenz
Attribution
Verified speaker
Claim type
belief
Recorded
15 Jun 2024
Publisher
The Cognitive Revolution

Transcript context

…Not yes. But it's a constitution of 1. It's like the person who actually does this and he tries to do the best. Of course, there's some government that are like of good taste. Right? We should not be like biased. We should be try to be as concise as possible. There are, like, certain things that are, like, common sense. But other than that, we do not have time enough to define guardrails or guidelines. We believe that it's more also an iterative process. The fact that we do certain fine tuning from time to time, what helps us that there are certain results that we think that they are very good. The results will be used to like to fine tune the model and the model should automatically learn what is the standard that we want. Right? And who decides what is good or not? The quality assessment team. Again, we don't have any editorial criteria. That goes without saying, right? We don't play politics. We do not do any censorship or anything like this. But at the end of the day, it's a matter of personal taste of whoever does the rating. But that's it goes for us, goes for anyone else. It goes for you, right? Do you prefer results from Perplexity or from us or from Google? The information is actually the same. It's just a style. Right? Yeah. I as a power user of all of these things, I have to say I I do find myself going to different services depending on the query. It seems like I've noticed and I would say I would I think Brave is in the middle, I would say, right now between like, perplexity gives me a lot of times the shortest, most to the point answer. You.com research mode is on the other extreme where it will give me, like, the 2 page thousand word. Obviously, that is not suitable for every query. And I would I know don't how you would have qualitatively described where Brave sits in relation to those. But for me, it seems like it would be in the certainly in the middle of those 2. But it's on the it's on the middle because because Brave has an extra complication compared to proficiency, and and we can discuss about that later. But it's a little bit like it's all it might sound very, like, unthoughtful, what I'm gonna say, but it's a little bit by chance. LLM 3 is much more verbose than Mixtral. It comes out of being more verbose, period. When we switched to LLM 3, we became more verbose than the Mixtral. We, of course, we can turn it down a little bit x y z, but it's certain inherent things that come out of the tools that you use. And in a way, we do not have the time or the will or know what is right in order for us to actually act upon. And then on those cases, the best thing to do is, like, try to do nothing. Right? But it's not stupid, but it's true. Right? If you do not know what is the right thing to do, you just I believe it as a model. Believe it as simple as that. Once I do have more data or I have more resources to do proper assessments and proper judgment, I will try to influence the model. But influencing just because someone on Twitter says something, which is very tempting. So that's 1 thing. And then on the it's very interesting what you said about that you use a different system for different queries because that's not what normal people do. Search is 1 stop shop. Right? And Brave Search is is search. And when people search, they don't want to discover. People search because they have a problem. They want to go to Hotmail or they want to go to port or they want to know, like, a recipe of mojito because they are doing the mojito right now. They don't want to discover the 2 pages history of mojitos or, like, a nice AI summary for mojito. They just want to know the ingredients and how to put it together quickly because you are in the middle of something. Right? And that's important to realize that whenever we think of search, we always like think of fancy questions or like complex questions that are thoughtful. But most of the queries are not like this. And because we are, like, the default search engine on many countries on the browser, we need to cater to the common denominator in a way. And that's actually something that is tricky. Right? Because but we could be much fancier if we had no traffic. Right?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.

Search evidence