Speaker unverified: belief

Transcript context

…I love this story. I so appreciate you sharing it. I imagine also with a big launch like this, you can't actually A/B test it ahead of time because of the press season. They're like, "Oh my God, look what Spotify's doing." And so you're limited there. Imagine, right? You couldn't really test this ahead of time. Gustav Söderström The hardest thing about this is if you're trying something completely new, the MVP needs to be very big so you can build a new IU, but if you didn't do algorithms for single item feed, you can't tell if it was the right idea but poor machine learning, right? UI poor machine learning. Or you have to build a lot and that gets quite expensive. That's actually ... The biggest why it's painful is not really the feedback from the outside. It is the cost you have to take on the inside. You incur a lot of costs as you're really hoping you're right. Gustav Söderström And in our cases, the changes on the homepage aren't that hard for us to do. The important thing is that the underlying hypothesis of, can we help you break out of your taste bubble actually works and then you update the acquisition funnels into that experience. But I think the problem is that you need to get so many things in place to be able to say, "You might get a false negative," just because you didn't do it well or not. That's the biggest challenge, I think, with these big rewrites where everyone has to update everything before you can know if you're right or wrong. What was that process like of helping you understand what is not working and what is working and what you wanted to change? I imagine there's a bunch of data you're looking at, some tweets, things like that. What was the tactical, "Oh, shoot, something's not going the way we expected, here's what we should do?"…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.