Public evidence record
Published podcast speaker
Books, apps, and tools
app / uses
“It runs Whisper, and you can do things like you can paste in the URL to a YouTube video and it'll pull the audio and give you a transcript. So, that's how I watch YouTube now, is I slap it into Mac Whisper, and then I hit copy and paste into Claude, and then I use the Claude web app to do things.”
app / uses
“It runs Whisper, and you can do things like you can paste in the URL to a YouTube video and it'll pull the audio and give you a transcript. So, that's how I watch YouTube now, is I slap it into Mac Whisper, and then I hit copy and paste into Claude, and then I use the Claude web app to do things.”
Claim ledger
53 transcript-backed records
01 / evaluation
“At the same time, they didn't get massively better than GPT 4, which was a bit of a surprise. So that's sort of one of the open questions is, are we going to see huge, but I kind of feel like that's a bit of a distraction because GPT 4, but way cheaper, much larger context lengths, and it [00:02:00] can do multimodal.”
02 / evaluation
“Like the few of those that have done well, I always feel like they're doing well because it's a gimmick, right? It's a it's it's novel and fun to like Like that, the AI Seinfeld thing [00:37:00] from last year, the Twitch stream, you know, like those, if you're the only one or one of just a few doing that, you'll get, you'll attract an audience because it's an interesting new thing.”
03 / uncertainty
“I don't know about Anthropic and OpenAI, but clearly that demonstrates it is possible to run these things at these ludicrously low prices and still not be running at a loss if you discount the Army of PhDs and the, the training costs and all of that kind of stuff.”
04 / belief
“I think for most people who haven't been paying attention, we know these things already.”
05 / evaluation
“[01:10:00] year. This one's interesting as well, because the thing that makes these interesting is multimodal, like audio input, video input, image input, which a year ago was hardly a thing, and now it's dirt cheap.”
06 / preference
“It runs Whisper, and you can do things like you can paste in the URL to a YouTube video and it'll pull the audio and give you a transcript. So, that's how I watch YouTube now, is I slap it into Mac Whisper, and then I hit copy and paste into Claude, and then I use the Claude web app to do things.”
07 / preference
“This is where I've been pushing the definition. I love the term slop. Where I've been pushing the definition of slop as AI generated [00:41:00] content that is both unrequested and unreviewed and the unreviewed thing is really important like that's the thing that elevates something from slop to not slop is if A human being has reviewed it and said, you know what, this is actually worth other people's time.”
08 / prediction
“Because yeah, the and that's, you know, so I feel like there is so much scope for innovation there and it is beginning to happen.”
09 / preference
“for running prompts through them. And then When you look at the, the really, the top tier model providers right now, I think, are OpenAI, Anthropic, Google, and Meta.”
10 / observation
“No one's I mean, [00:31:00] that's my thing is I realized that for generative images and images and video like images We've had for a few years and I don't feel like they've broken out into the talented artist community yet Like lots of people are having fun with them and doing and producing stuff.”
11 / evaluation
“It's a bit of a, it's a total gimmick, right? But that gimmick got them attention, because they had a great product that nobody paid any attention to at all.”
12 / commitment
“I'm building my own version of this for my own project, because I think within six months.”
13 / evaluation
“ChatGPT can never stake its reputation on telling you something useful and interesting because That means nothing, right?”
14 / prediction
“The trick that O1 and O3 are doing, which means that you can solve harder problems, but they cost more and it churns away for longer. I think that's going to happen because that's already proven to work.”
15 / belief
“I haven't really gotten into cursor yet to be honest. I just haven't spent enough time for it to click, I think.”
16 / uncertainty
“Like Google Gemini you can do an hour's worth of video in their context window and just by slicing it up into one frame At ten frames a second and it does work so I Don't know.”
17 / preference
“Currently, I run them through Whisper and then I do the transcript that way, but being able to do the multimodal thing with those would be really useful.”
18 / preference
“That's cool, because I've been using Google Gemini's bounding block stuff recently, it's very, very impressive.”
19 / evaluation
“Effectively, the JSON thing is, they're doing the same kind of trick as Llama Grammars and JSONformer. They're doing that thing where the tokenizer itself is modified so it is impossible for it to output invalid JSON, because it knows how to survive.”
20 / evaluation
“They've kind of deprecated plugins. They haven't said it out loud, but a bunch of people, but it's clear that they are not going to be investing further in plugins because the new actions thing is covering the same space, but actually I think is a better design for it.”
21 / recommendation
“You listen to this dumb two minute long speech that I just got language not generated and I'm like, wow, no, that's making some really good points about why we should care about Pelicans, obviously I'm biased because I like Pelicans, but oh my goodness, you know, it's like, who knew that just getting it to talk out loud with that little bit of additional emotional sort of clarity would elevate the content to the point that it doesn't feel like just four paragraphs of junk that the model dumped out.”
22 / uncertainty
“Like these and these days, 150 megabyte. Well, I don't know. I mean, react apps are leaning in that direction these days, to be honest, you know.”
23 / prediction
“I think we're going to see a huge amount of GPT side projects, because it doesn't, it's now, doesn't cost me anything to give you access to the tool that I built.”
24 / preference
“Like, I want to control when I'm using the gold model versus when I'm not, which I can do because I created myself a custom GPT that does what I need.”
25 / belief
“I don't care about the doom scenarios. I care about building stuff with, with what we've got.”
26 / commitment
“Again, if somebody wants to be really useful, publish a nice detailed step-by-step instructions, they're getting that working and I will benefit from it and so will load of it.”
27 / belief
“I agree with everything you say, but at the same time, right now, I've got a whole bunch of models that I'm choosing to be to, to, that I'm trying to choose between, and I don't have the information I need to make the decision.”
28 / recommendation
“Could somebody please figure out how to do that with hugging face transformers, then publish the world's most straightforward how to do this document because I have not managed it yet.”
29 / evaluation
“I don't, I'm really frustrated by this because the, the language says you cannot train a competing large language model.”
30 / belief
“I tried uploading the git binary to it at one point and I think that didn't work.”
31 / commitment
“I find that for the kind of stuff I'm doing, normally what I'll do is I'll take the code I'm working on, I will reduce it to the shortest sort of example that, that shows what I'm trying to do to use less tokens, copy and paste that in.”
32 / belief
“One thing I would say is that if you can upload up to a hundred megabytes, a hundred megabyte file, if you, you can, for most business on six problems, you can get that down to less than a hundred megabytes of data.”
33 / belief
“I think as the worst thing about learning to program is figuring out how to set up a development environment and all of that junk.”
34 / commitment
“I'll I will stick that in the chat cuz the, the transcript of the conversation I just have, cause that's fascinating.”
35 / belief
“I think there's a, I think there's a fine tuned model under it, which, if that's the case, then replicating it using functions is gonna be pretty difficult.”
36 / evaluation
“That doesn't seem to work anymore. I am heartbroken by that because I was using that for all kinds of shenanigans.”
37 / recommendation
“Let us like use it via the api, but have our own function that de evaluates code, because then I can build my dream version of code interpreter with.”
38 / commitment
“Well, well because, so my day job, my, my, my principal project, I ru, I run this open source project called Dataset, which is all about building tools to help people interrogate their data.”
39 / preference
“I don't want to spend five or 10 minutes tediously debugging my way through it, through a, a nested list algorithm, but I'm happy for code interpreter to, to go ahead and do that. And in fact, when it wrote the code, I watched it make the exact same mistakes I would've made, like forgetting, getting off one off by one errors and all that kind of thing.”
40 / preference
“Because I want to run this thing, but I want to control the container and I want to give it network access, all of that kind of stuff.”
41 / evaluation
“Yes. So in that case, that means that some of the thick barriers I've been running to are more the model being told no, pretend that you can't do it.”
42 / evaluation
“Because it, it just, it gives you so many capabilities that ChatGPT and even ChatGPT with plugins doesn't really touch you on, especially if you know how to use it.”
43 / evaluation
“Like cuz the, the problem if, if the function is delete my email, it doesn't matter if you get the schema right or not, it's still, it can cause a harmful action.”
44 / belief
“I'm going to, I have things I'm going to build on top of this, but I'm gonna be very careful about the, I think the reversibility.”
45 / belief
“I feel a lot more confident in using it. So I think that makes a big difference.”
46 / belief
“I want widgets in chat. GPT I think chats a terrible interface. I would like to be able to build it like a ChatGPT plugin that could say, now show them a map, now ask them to pick something from this list of options.”
47 / commitment
“You need to, sometimes you need to say, no, I cannot build the feature you're asking me to build because it can't be built securely.”
48 / evaluation
“Is that pipeline and JavaScript have a million packages. So no matter how good your new language is, if it can't tap into those existing package libraries, it's, it's not gonna be useful for, which is why Moji is so clever, because they did build on top of Pips.”
49 / belief
“I think maybe they're just the first people to try and build a high, try and combine a high level language with M L A R, with some extra things.”
50 / evaluation
“Like that's one of the things where I feel like, yeah, vicuna running on my, on my laptop is probably powerful enough to drive a sort of personal research assistant, which can look things up for me and it can summarize things for my notes and it can do all of that and I don't care. But it doesn't know about the Ukraine war because the Ukraine war training cutoff, that doesn't matter.”
51 / evaluation
“Is, is, is a better source of information for than Google now. And so, yeah, I'm not, it doesn't surprise me that Google would see this as an existential threat because whether or not they can be Bard, it's actually, it's not great, but it, it exists, but it hasn't it yet either.”
52 / evaluation
“There's good reasons to believe it is leaked from Google, and to be honest, if it's not, it doesn't actually matter because the quality of the analysis, I think stands alone.”
53 / preference
“Like Vicuna 13 b i i, I, I think is the current best available open mo model that I've played with.”