Nathan Labenz: recommendation

Transcript context

…I mean, technical AI safety definitely does seem to sometimes improve capabilities and therefore accelerate AI overall. The question is just, are you getting enough benefit out of it to make up for that cost? Because world where we don't do any safety research also seems pretty scary, right? My sense is it's best to have a thriving safety ecosystem who are really tracking the biggest risks and trying to do something about them, even if they will also accelerate things a bit even more compared to a counterfactual where basically things are still going very fast, but we don't have a safety research ecosystem. It does depend on whether you think, if you just think alignment or AI control is ultimately impossible, then yeah, that doesn't make sense. I think a bigger point I might make about this is like, I guess I come at this from a perspective of just we're very uncertain about all of these different priorities and what's going to happen. And that, at least for me, makes me intuitively want to see a bit of a portfolio of efforts across different scenarios. And so I'm like, I'm pretty into the idea of there being some people who are really trying to build support for some type of international pause. I think like a one year pause at the point at which an algorithmic feedback loop becomes possible or some kind of temporary pause seems like it could be extremely helpful. At the very minimum, that's like a thing that I think many people could agree upon. But then I do also want there to be a lot of effort going into the scenarios where, no, this is happening, like it's not really pausing. and just betting 100% on the pause seems that's leaving a lot of like low hanging fruit on the other scenarios on the table. Yeah, portfolio approach, I think is kind of always an answer to this. It does seem like there's room for it. I mean, it depends on your probabilities on the different scenarios, like what your portfolio would be. But at least for me, they're also pretty spread out.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.