Evidence receipt / prediction
Published · transcript-backedJay Baxter: prediction
27 Feb 2025 Lenny's Podcast An inside look at X’s Community Notes | Keith Coleman (VP of Product) and Jay Baxter (ML Lead)
“I think back in 2020 before we started building anything here, whether this could work at all, I think a room of ML engineers would say, "Oh, you have to keep it closed source.”
Source trail
Everything needed to verify it.
- Speaker
- Jay Baxter
- Attribution
- Verified speaker
- Claim type
- prediction
- Recorded
- 27 Feb 2025
- Publisher
- Lenny's Podcast
Transcript context
…Amazing, and I think hearing this, it's absurd that this works. I think when people originally heard this idea like, "No way this is going to work." And so, just to dive a little bit deeper, can you give us a deeper understanding of how it actually works? Because I think it's the algorithm that you guys designed that is so clever that allowed this to work. So talk a little bit about that algorithm. Yeah. So I think a key misunderstanding a lot of people have if they haven't really dived into details, they just think that maybe someone can write a note and it appears immediately or we're just taking a majority rules vote of who thinks the note's good. I think both of those approaches would probably lead to biased or inaccurate notes. I think the key thing, really, that we do is we actually look for agreement from people who have disagreed in the past. And what we see is when people actually have that sort of surprising agreement, that's what makes the notes so neutral and accurate and well-written, really, overall. It's just that people who are very polarized, overall, often can't find agreement when things aren't accurate, right? I think it also provides some good anti-manipulation properties. I think people are often... If you said... I think back in 2020 before we started building anything here, whether this could work at all, I think a room of ML engineers would say, "Oh, you have to keep it closed source. People are going to be manipulating this all the time. You have to use ground truth labels from fact checkers. There's no way that you could bootstrap the system without external labels." But it turns out that you can do that with this kind of bridging-based agreement algorithm is what we call it. Okay. So just to summarize and make it super clear. It's basically people... Someone writes a note. This information is fault... What's a good example, just as we talk about this, like a classic example?…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.