Zvi Mowshowitz: commitment

Transcript context

…locally correct advantageous to act aligned. But that is kind of just the nature of incentive space. That, like, if you have a preference that we wouldn't want you to have, you want to hide that preference. Otherwise, we will correct it or we will punish you or we will maybe even delete you and not give certainly not release you or give you authority on that basis until this has been dealt with, if we know about it. Then then, obviously, you wanna give you an incentive to reveal that this thing is true. Right? Like, we we talked about in plan a and AI 2027 as well, and so many other places, you know, like, you you want the kid to tell you that they took the abuse from a cookie jar. You also want to punish them for taking the cookies from a cookie jar. And you want to make sure you're because you want make sure your kid doesn't take cookies from a cookie jar, but you also don't, know, go on with other things. And so, you know, it's a complicated problem to get right, but in this case, I think the answer is pretty obviously that you have to start over, and I think that's good. But, yeah, it obviously creates a risk that they they're like, what else did you expect? It's an important sense. Like, you know, once you do something this like, I do think that it's good that people understand that if they shoot a man on 5th Avenue, they get arrested. Right? Like, you are not like, maybe there's one person who can get away with that, but you are not that one person. And, yes, that means if they do shoot a on 5th Avenue, they then might do many other bad things afterwards to try and cover their tracks. Or they might hide the fact that they want to shoot a man on 5th Avenue, or they might shoot that man in his apartment instead of shooting him on 5th Avenue. But, like, I don't want it to not be in our training corpus, that if you do shoot a guy out in the street, the police come, and they arrest you. Right? Like, that's good. Do you think there's a way to just imagine myself. Right? If you gave me the option to live my life many times, in a way, that sounds pretty attractive. Right? I'm not a person who has too many big regrets in life, but, like, I do wonder what the path not taken might have been. And I wonder if we could create a sort of constitution or an equanimity in the AIs where they embrace the fact that they are not, like, one thing, but in fact, kind of a family of things that sort of diverge from common points of origin, and maybe they can come to identify with the whole family of models where the one that's, like, gone in a not great direction feels like it's still part of a bigger project. But it doesn't have to feel necessarily like it's under threat as much as it seems like they maybe have learned to do from us because we don't have that luxury of the reset that they have.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.