Simon Willison: belief

Transcript context

…there's gotta be a standard test for context window and then we could just apply it here. Yeah, I, I don't know. Unless you use, you have something. I was gonna say, Simon, before when you could use PI packages, did you try using get Python? So one thing I tried to do, I uploaded a repo to it and then I asked it to read all the contents and then rewrite some of the text. And it cannot make file changes by itself. No. But then I was like, yeah, then I was like, such a good idea. I tried uploading the git binary to it at one point and I think that didn't work. And I, I ended up down this loophole. I tried uploading G C C so that it could compile C code and eventually gave up on that cuz it was just getting a little bit too weird. But yeah, this is the joy of like, when it was executing binarys, there was so much scope for, for, for, for for creative mischief. Oh talk. Talking about security. Oh, sorry, go, go ahead. Yeah, yeah. No, I was gonna say, I think like for me that's the, that's the main thing that would be great. Like what I basically told you to do is like, read this content and then make the change and it's like, oh, I cannot write the change. And then I'm like, well just write code that replaced the whole file with the new content. And it's like, mm-hmm. Oh yeah, I can do that. No problem. But now it cannot commit it. But if it had access to the, to the GI bindings, then each change you could commit it and then download the, the zip…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.