Evidence receipt / evaluation
Published · transcript-backedKristen Berman: evaluation
2 Oct 2022 Lenny's Podcast Using behavioral science to improve your product | Kristen Berman (Irrational Labs)
“We came up with a hypothesis, and we had probably 30 different ways to implement this because the hypothesis is just a starting point.”
Source trail
Everything needed to verify it.
- Speaker
- Kristen Berman
- Attribution
- Verified speaker
- Claim type
- evaluation
- Recorded
- 2 Oct 2022
- Publisher
- Lenny's Podcast
Transcript context
…Can you talk a bit about how you came to those two conclusions? I know you work really closely with the product team and there's this whole process you go through. How do you come up with these ideas? How many ideas did you test? Is there anything more you could share on that? Yeah. It's actually a pretty involved process. First, we did a literature review which is basically saying like, Look, we're not the first people to think about this. Let's talk to the expert and understand what has worked and what hasn't." So, with that, actually, one of the insights was that reminding people about their value of accuracy. So, most people want to be accurate. Most people actually don't want to share this information. And so, if you can remind people at the point of sharing... By the way, it doesn't work if you remind people before or after. It's at the point of sharing, that this is unverified information, studies have shown that this could decrease share. So, we took that piece. We also took the hot and cold state literature that says, "If you actually don't want to get someone to do something, how do you intervene? So, we did this literature review. We came up with a hypothesis, and we had probably 30 different ways to implement this because the hypothesis is just a starting point. And then, we put it into quantitative research. So, we actually put five different version of the popup in front of over a thousand users, which... We got users from Prolific, which is a platform where you can easily test things. Prolific? Cool. I haven't heard that.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.