Lenny Rachitsky: belief

Transcript context

…You have some way of using data to get this conviction, and show why this is what we should do, but try to learn how to build that faster CME, slight difference. So, it's less product managers or me saying, "Hey guys, I think it's X." It's generally data driven, and qualitative insights driven as well. Personally, I would always index towards running experiments just to put this out there, but I think in this case, it makes sense, where you just know, "We need to do these three things, just make it cheaper, make it faster. " You don't need to AB test every idea there. Probably the main downside of not testing everything is you may be hurting things along the way, and you may not know it. I mean, yeah, so we definitely do... So you're right. But there's a very different thing to when you look at the... From a sample size perspective, you want to do a beta, and understand the negative impact. It's a holdout group that's smaller, than a test to get a significance. It's quite define the criteria to know whether something is breaking, is generally a different thing to say, is this a material result in a test? Yeah.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.