High Signal Podcasts Evidence ledger
Method
Browse
← Back to evidence

Evidence receipt / evaluation

Published · transcript-backed

Simon Willison: evaluation

10 Jul 2023 Latent Space Code Interpreter == GPT 4.5 (w/ Simon Willison, Alex Volkov, Aravind Srinivas, Alex Graveley, et al.)

“That doesn't seem to work anymore. I am heartbroken by that because I was using that for all kinds of shenanigans.”

— Simon Willison

Source trail

Everything needed to verify it.

Speaker
Simon Willison
Attribution
Verified speaker
Claim type
evaluation
Recorded
10 Jul 2023
Publisher
Latent Space

Transcript context

…was an emoji. I thought it was a somber, but yeah, seriously, you could upload new packages into it and it would install them and use them. That doesn't seem to work anymore. I am heartbroken by that because I was using that for all kinds of shenanigans. But yeah, and so you've got it as a sort of mul, it's a multi-tool for working with all of these different file formats. A really fun thing I've started playing with is it can work with file formats that it doesn't have libraries for if it knows the layout of that file format, just from what knows about the world. What, yeah. So you can tell it, I'm uploading this file, and it'll be like, oh, I don't have the live with that. And you can say, well, read the binary bys and start interpreting that file based on what you know about this file format. And it'll just start doing that. Right. So that's, that's a fascinating and creative thing you can start doing with it. Here's a fun thing. I wanted to process a 150 megabyte CSV file, but the upload limit is a hundred megabytes. So I zipped it and uploaded the zip file, and it was like, oh, a zip file. I'll unzip that. Oh look, a CSV file. I'll start working with it. So you can compress files to get them below that limit, upload them, and it'll start working with them that way. I think I read this on your blog or maybe Ethan No's blog where, where I sent us and I just zipped my whole repo for my project and just uploaded all of it and said, Hey, you know, start working with me and started asking it to do things. And one thing I did notice is that sometimes, you know, the doesn't know that it can, I think also in Ethan it says you can encourage it. You can like say, yeah, you can, yeah, you can do this. You now have access to code. And then it's like, okay, let me try. And then it succeeds.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.

Search evidence