Roman Yampolskiy: belief

Transcript context

…Control and monetize. Hoping they can control and monetize. So you’re saying if they could press a button, and create an agent that they no longer control, that they have to ask nicely, a thing that lives on a server, across huge number of computers, you’re saying that they would push for the creation of that kind of system? I mean, I can’t speak for other people, for all of them. I think some of them are very ambitious. They’re fundraising trillions, they talk about controlling the light corner of the universe. I would guess that they might. Well, that’s a human question, whether humans are capable of that. Probably, some humans are capable of that. My more direct question, if it’s possible to create such a system, have a system that has that level of agency. I don’t think that’s an easy technical challenge. It doesn’t feel like we’re close to that. A system that has the kind of agency where it can make its own decisions and deceive everybody about them. The current architecture we have in machine learning and how we train the systems, how to deploy the systems and all that, it just doesn’t seem to support that kind of agency.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.