Nathan Labenz: belief

Transcript context

…Yeah. Well, yeah. So our setup we're like I'm, I'm running this virtual machine on my MacBook, but then the weights are living on one of opening Eyes machines or Anthropics machine. And I'm just, I'm just interfacing with that via an API where like my computer's talking to their servers and doing some encryption authentication. And then each time the model calls a tool, it's like, who am I? It's, it's like open AI servers tell, you know, tell, tell my computer what the model wants to do. My computer does it and then sends back the response to open AI's computers. With Mythos, it's working the same way, but instead of it being my MacBook, it's just a different computer that Anthropic is running. In this case a virtualized computer. But it wouldn't have to be a virtualized computer. It could be controlling A literal laptop if that would be fine, and the literal laptop within an entropic office could just be like talking to the another server that happens to be running the Mythos weights. You can kind of see why you wouldn't want to give Mythos access to the literal computer that's running its weights like you could. You could also give it a terminal on that computer. There's no reason you couldn't except that it would be a dumb idea because now it would be a lot if it if it if it was on that computer. And then it find a way, it found a way to call out, well, now it might just be able to copy its weights directly to that other computer on the Internet. Did that make sense? Oh, yeah. And then you could air gap it all. By the way, I'm like, you could just have it be the case that like you have a, you have a computer with the weights and then you have a computer that you're like running the experiment on in that neither of these computers have access to the Internet even at the physical layer. Like you could, you could be in a data center where you're running this experiment and there's like in your experimental computer is also plugged into this network. But like your experiment computer doesn't have access to the Internet. And you could have this complete air gap, which like we will probably get to at some point very soon if companies aren't already doing this in some cases. And that would be you'd have a lot less risk that the model could escape. So that's, that's very physically possible. We just companies don't do it yet because it's annoying and expensive and no one wants to be like out there at the data center like doing this experiment. But you could, yeah, it's it's a lovely life in the Bay Area. And yeah, who wants to move to the middle of nowhere to Co locate with the models waits. But yeah, I mean, it's not far fetched at this point to think something like that might be an important step, I guess to make this practical for people and companies. First of all, like what is the state of cybersecurity? We we always have heard everything's hacked. My working assumption for the last 10 years has been everything's hacked. And, you know, any online accounts I have or you know, those credentials are probably out there. Honestly, for a while when Chrome was telling me, oh, you have this password that's been compromise, I was just like, whatever, it's probably all compromise. Do I even really, does that even matter? You know, I've heard like the White House's systems are hacked and Congress is all hacked. Everything's hacked, has been, you know, I think a pretty good baseline, yet I don't have any major problems. On the other hand, I also hear things like AWS has really robust formal methods based guarantees for why I with one EC2 instance like won't be able to break out of my EC2 instance and mess with EC2 instance. This is very confusing I think. Assuming you're hacked is a bad practice. I think it's a It's like a bad. It's not just epistemically bad, I think it's actually practically bad. And here's why it will make you, you know, make the mistake that that Pete Hegseth or whoever in that signal chat. So there's like famous incident where a whole bunch of defence Department, Department of war officials like we're coordinating. Do you remember which, which strike was it? And they added it was maybe Iran or the early Iran strike.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.