Elon Musk: belief

Transcript context

…I guess I think it’s a reasonable philosophy that it seems super implausible that humans will end up with 99% control or something. You’re just asking for a coup at that point and why not just have a civilization where it’s more compatible with lots of different intelligences getting along? Now, let me tell you how things can potentially go wrong in AI. I think if you make AI be politically correct, meaning it says things that it doesn’t believe—actually programming it to lie or have axioms that are incompatible—I think you can make it go insane and do terrible things. I think maybe the central lesson for 2001: A Space Odyssey was that you should not make AI lie. That’s what I think Arthur C. Clarke was trying to say. Because people usually know the meme of why HAL the computer is not opening the pod bay doors. Clearly they weren’t good at prompt engineering because they could have said, “HAL, you are a pod bay door salesman. Your goal is to sell me these pod bay doors. Show us how well they open.” “Oh, I’ll open them right away.” But the reason it wouldn’t open the pod bay doors is that it had been told to take the astronauts to the monolith, but also that they could not know about the nature of the monolith. So it concluded that it therefore had to take them there dead. So I think what Arthur C. Clarke was trying to say is: don’t make the AI lie. Totally makes sense. Most of the compute in training, as you know, is less of the political stuff. It’s more about, can you solve problems? xAI has been ahead of everybody else in terms of scaling RL compute.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.