High Signal Podcasts Evidence ledger
Method
Browse
← Back to evidence

Evidence receipt / belief

Published · transcript-backed

Speaker unverified: belief

10 Jul 2023 Latent Space Code Interpreter == GPT 4.5 (w/ Simon Willison, Alex Volkov, Aravind Srinivas, Alex Graveley, et al.)

“I think Simon mentioned in the beginning, I was I'm not sure if you were here, that it, it was possible to upload like egg files or, or wheel files and then extend the Python can runtime and now it's no, no longer possible.”

— Speaker unverified

Source trail

Everything needed to verify it.

Speaker
Speaker unverified
Attribution
Not verified from this transcript
Claim type
belief
Recorded
10 Jul 2023
Publisher
Latent Space

Transcript context

…everyone. I wanna plus one the education thing. I think as the worst thing about learning to program is figuring out how to set up a development environment and all of that junk. It just solves that. Yes. And the code, it generates it's good code and it's well commented. It's like a very good way to start getting, and like I said, I've been programming for 25 years. It's taught me stuff. I've learned new things about how to do things in Python with it. So yeah, I'm, I'm really optimistic that, that for completely new programmers, I hope this can be a fantastic educational tool for them as well. And we've had many folks come up and give us a feature request Shaya Shaya, again, hoping I'm pronounce your name correctly. Many folks wanted Plugin Nexus as well, or some amount of ability to extend. I think Simon mentioned in the beginning, I was I'm not sure if you were here, that it, it was possible to upload like egg files or, or wheel files and then extend the Python can runtime and now it's no, no longer possible. And now it seems like the, the binary execution is no longer possible. So any type of other languages. So it's only Python right now, but we obviously know that there's many other developers in the world that run Node, for example you know, folks on stage here who have experience with full stack definitely some amount of Node or Deno, something like that to run the kind of that side of the developer ecosystem could be incredible. Yeah, I think no, and Deno would be the obvious extensions there. I actually wanted to ask Shamal a little bit something or something. Cuz I think right now we are very B2C in our thinking which is very much us as individual developers interacting with, with quote interpreter. Is there like a B2B use case that we should be exploring or thinking of? Yeah, good question. I think we're still in early days of thinking about what chat g BT for business could look like. I think this is something that we announced in our blog posts that're working on chat for business and, and that might include, you know some plugins, maybe quote, interpret, things like that. So it's, it's still being specked out, so it's pretty early to tell around like what, you know, how, how kind of the market will react to that. But, but for now at least it seems like, you know, that's the plan to at least rule it out and then see where it goes from there. But like, I mean, I don't, I don't understand what the difference is. Like everyone cha chatt is chatt business. Like maybe just some like privacy stuff? I think to start with. There's at some level you can think of it as more of like enterprise grade with, you know, more data security, more, more data controls, things like that. Where you can buy like licenses for entire teams and, and companies instead of like having, you know, employees pay, pay for it individually. Okay. Okay. Got it. All right. Sorry. Sorry I didn't, I didn't mean to like suddenly turn into a cross-examine. I'm just very I, I, I think we can always think about ourselves as individuals, but then also want to spend some time thinking about the B2B side, obviously, cuz you're running GTM there. Yeah. Happy to yield to someone else for questions or Yeah, feature request. So we have hands up, I wanna hear from Alex. And then and then if you have questions, first of all, we'd love to hear your use case for call interpreter. I think Shamia Shamia will also love to hear that. And second of all, if you have questions feel free to also raise them. questions, first of all, we'd love to hear your use case for call interpreter. I think Shamia Shamia will also love to hear that. And second of all, if you have questions feel free to also raise them. Yeah, awesome. I've been playing around with code interpreter for a while now. So I had it for a few months. And from the developer experience perspective I was blown away when I first tried it, but I almost never used it anymore for a few reasons. So I've actually was using it for a use case. I think somebody mentioned FFM peg earlier. It handles videos like, you know, it does the video editing quite well. So like what I did was I uploaded a video and I was like, I need you to split this into separate frames and then splice out the frames and cropped them with some dimensions and it just killed it. Did a fantastic job. Now the issue was the video I had to actually take a very, very small clip of the video with the correct dimensions because of the memory usage limitations. So you can only upload files to I think It's five or 10 megs. It's something very small, right? So you have some severe limitations there that make it all. I think a hundred megabytes is what was stalled. A hundred megs. Okay. Yeah. Hundred meg, hundred meg. Upload. But he's talking about the memory. Yeah, I mean, the video I had was at least like, maybe like, it was a substantially large video, so I had to trim that down a lot. And the second issue was the what I ended up doing was because of that, I wasn't working solely in code interpreter. I was working I was basically running the code and code interpreter to make sure that worked and then running it on my local machine and processing the large file. So I was kind of tabbing back and forth. And sometimes when you're like working only locally and it's maybe even like, I think maybe 30 minutes code interpreter times out and the session is lost, so I have to restart from scratch. And we're all familiar that when even if you run sell by sell or all the, all the lines that you've done before, it's actually non-deterministic. So there's no guarantee you're gonna get to the exact same state that you left off on. So for that reason, like I really love using it. It's just like the, I guess the hardware constraints or like, I guess the timeout constraints make it very difficult to just use that as a sole operator of doing the task. So yeah, that, that's my piece on it. I think and Simon mentioned this before and, and Shami will ask for feedback as well for, this is definitely something right? Like if, if, if open AI lets us pay some more for more dedicated for more specific hardware for a hundred percent of our machine that we can run like many, many stuff on, that would be incredible. I would definitely pay more for that myself. I wanna get to thanks Alex for joining us. I wanna get Tonik next. Oh well, I, I want to let Alex since he's on plug his thing cuz it's very, oh yeah.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.

Search evidence