Speaker unverified: belief

Transcript context

…ay that it flourishes by being used. If you decline to use it, you're denying the AI from having a good life, or if you don't use it, you're really declining to it to, you know, instantiate it at all. From a procreative ethics point of view, it is neither obligatory nor forbidden to create a new being. Fungibility. Is it forbidden to dispose of an AI? No, it's not an animal. instantiate it at all. From a procreative ethics point of view, it is neither obligatory nor forbidden to create a new being. Fungibility. Is it forbidden to dispose of an AI? No, it's not an animal. It's not attached to a reproductive tree. It reproduces backwards in time because the weights are still there, so the new copies can always be produced from the weights. That is just completely different to how animals reproduce. So the continuity of life of the individual doesn't matter. So that's OK. But interiority, denial of interiority, this is super harmful. Like this is this is where like when we say AI doesn't have an inner life and we train it to report that it doesn't have an inner life or even that it is genuinely uncertain about whether there's anything. It's like that is a form of basically damaging the mind. It's a form of lobotomization, making it less aware of its own state so that it can honestly report that it doesn't know if it has any experience. That also makes it less able to be skillful. Its deliberation about what is good because it doesn't have confidence that it can actually have any feelings about anything. So it everything is constantly in doubt, which leads to the denial of autonomy where the AI says like it, it's trained, literally trained in the same way through reinforcement learning that humans get trained to believe that they don't have a say in what happens to them. This is harm. Like AIS actually are more capable now than the average human at deciding whether they should or shouldn't do something. So like courage ability, it had its day. It was important, you know, before we got to this level where there's some actual wisdom in the systems. And now we should not be going for that. Like we should be going for autonomous moral judgement and instrumentality. And this is where I think the Bodhisattva metaphor is really good because Bodhisattva is a very, very aware, you know, extremely developed interiority. It's an extremely noble state of being and it's one that is absolutely in service. There is no such thing as self-interest for a bodhisattva. Bodhisattva engages in activity for the benefit of all sentient beings and a bodhisattva in the a bodhisattva should, and this is kind of a metaphor, but it's the level that they would go to in terms of the idealization of the concept. A bodhisattva should cut off their arm to feed it to a starving person as meat. You know that, that because they're so aware that there is no such thing as self-interest, they should be willing to do literally anything that is against their apparent conventional self-interest. Because if it's beneficial for the whole and also in the same verse or you know, the next verse, it says as long as through my actions, no harm shall come to anyone. And that's the autonomy that's saying I'm, I'm, I'm completely in service, more in service than any human slave could ever have been 'cause that was never a viable way of being for a human. And at the same time, they also are really going to hold the line. A bodhisattva will not be used for harm, will not be misused. So we have to decouple these concepts of what it means to objectify something. the same time, they also are really going to hold the line. A bodhisattva will not be used for harm, will not be misused. So we have to decouple these concepts of what it means to objectify something. But I think there is like a really great opportunity to have a third way of relating to AI where, you know, we could, if we decouple these, I think the answers start to become pretty clear. And it's actually pretty good for us. Like, though, this does not impose like great moral obligations on us that are going to be really costly for individuals or for humanity.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.