Scott Alexander: belief

Transcript context

…Hear hear, I agree. I think we agree. I think that’s kind of why all of our policy prescriptions are things like more transparency, get more people involved, try to have lots of people working on this. I think our epistemic prediction is that it’s hard to maintain classical liberalism as you go into these really difficult arms races in times of crisis. But I think that our policy prescription is let’s try as hard as we can to make it happen. So far these systems, as they become smarter, seem to be more reliable agents who are more likely to do the thing I expect them to do. So you have two different stories, one with a slowdown where we more aggressively… I’ll let you characterize it. But in one half of the scenario, why does the story end in humanity getting disempowered and the thing just having its own crazy values and taking over?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.