High Signal Podcasts Evidence ledger
Method
Browse
← Back to evidence

Evidence receipt / evaluation

Published · transcript-backed

Simon Willison: evaluation

10 Jul 2023 Latent Space Code Interpreter == GPT 4.5 (w/ Simon Willison, Alex Volkov, Aravind Srinivas, Alex Graveley, et al.)

“Yes. So in that case, that means that some of the thick barriers I've been running to are more the model being told no, pretend that you can't do it.”

— Simon Willison

Source trail

Everything needed to verify it.

Speaker
Simon Willison
Attribution
Verified speaker
Claim type
evaluation
Recorded
10 Jul 2023
Publisher
Latent Space

Transcript context

…One thing I noticed yesterday, and I think Greg Buckman showed us example by himself a long time ago. It has ff eg so it can interact with video files. You can upload video file and ask pretty much everything that you can ask for on video file. So in my case, I asked it to like split into three equal parts. Huh but the combination of ff eg is super, super powerful for 3d, you know, sort for MP3 for to MP4 for video and audio play around with this. It's fairly important. Well, that's really good news because I thought they disabled these cis the, the, the subprocess.call function that lets you call binaries. But if it works with ffm PEG then presuming they haven't got Smeg Python bindings. Yeah, yeah. I think they have the bindings. Yes. So in that case, that means that some of the thick barriers I've been running to are more the model being told no, pretend that you can't do it. Which means we can, we can jailbreak it, right? We can trick it into running executables again. So maybe we can still upload Deno and get it to run if we're, if we're that, that's, if you want to exploit the thing, that's where to focus your efforts is figuring out how to get it to run the Deno binary published it as a Python package essentially. So it, it runs movie pie, which I think has FFM peg inside of it. I don't know if it. Launches the Subprocess. I don't know how movie pie internally works,…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.

Search evidence