Evidence receipt / evaluation
Published · transcript-backedSimon Willison: evaluation
10 Jul 2023 Latent Space Code Interpreter == GPT 4.5 (w/ Simon Willison, Alex Volkov, Aravind Srinivas, Alex Graveley, et al.)
“Yes. So in that case, that means that some of the thick barriers I've been running to are more the model being told no, pretend that you can't do it.”
Source trail
Everything needed to verify it.
- Speaker
- Simon Willison
- Attribution
- Verified speaker
- Claim type
- evaluation
- Recorded
- 10 Jul 2023
- Publisher
- Latent Space
Transcript context
…One thing I noticed yesterday, and I think Greg Buckman showed us example by himself a long time ago. It has ff eg so it can interact with video files. You can upload video file and ask pretty much everything that you can ask for on video file. So in my case, I asked it to like split into three equal parts. Huh but the combination of ff eg is super, super powerful for 3d, you know, sort for MP3 for to MP4 for video and audio play around with this. It's fairly important. Well, that's really good news because I thought they disabled these cis the, the, the subprocess.call function that lets you call binaries. But if it works with ffm PEG then presuming they haven't got Smeg Python bindings. Yeah, yeah. I think they have the bindings. Yes. So in that case, that means that some of the thick barriers I've been running to are more the model being told no, pretend that you can't do it. Which means we can, we can jailbreak it, right? We can trick it into running executables again. So maybe we can still upload Deno and get it to run if we're, if we're that, that's, if you want to exploit the thing, that's where to focus your efforts is figuring out how to get it to run the Deno binary published it as a Python package essentially. So it, it runs movie pie, which I think has FFM peg inside of it. I don't know if it. Launches the Subprocess. I don't know how movie pie internally works,…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.