tool / uses
Zo
“I think there’s been one thing, I use another thing called zo, which is kinda like a cloud computer plus agent.”
Public evidence record
Partner · Decibel
Books, apps, and tools
tool / uses
“I think there’s been one thing, I use another thing called zo, which is kinda like a cloud computer plus agent.”
tool / likes
“First of all, you have very good support for mocking in unit tests, which is something that a lot of other frameworks don't do. So, you know, my favorite Ruby library is VCR because it just, you know, it just lets me store the HTTP requests and replay them.”
other / likes
“Yeah, I'm a big fan of Simulative AI. We had a summer of Simulative AI. Another term we're trying to coin.”
Claim ledger
125 transcript-backed records
01 / belief
“I think most people have heard of Applied Intuition tied to YC when it was first started, and then you were kinda in stealth for a long time, so maybe just give people the high-level overview of what it is today, and then we’ll dive into the different pieces.”
02 / belief
“You’ve not mentioned hardware at all, like sensors or obviously we you mentioned you don’t do chips. I think even in AV there’s, like, a big, cameras versus lidars.”
03 / belief
“I remember initially, I think people put you and Scale AI very similarly for some things about being kinda like on the data infrastructure side of things.”
04 / belief
“” I think a lot of founders are in a similar way where they wanna raise a lot of money to signal they’re strong, and you raise a lot of money without spending it.”
05 / belief
“Definition of Turbo puffer, because I think you could be a Vector db, which is maybe a bad word now in some circles, you could be a search engine.”
06 / belief
“You know, I think sometimes it’s like, well, these are the tradeoffs, but the three nines, it’s like, actually it’s not a real trade off because we can make something that nobody has ever made before and actually make it work.”
07 / belief
“Can I do it with a hundred, if I need a trillion healthcare tokens, it’s like, they’re probably not out there that you don’t have, you know, I think that’s really like the.”
08 / belief
“Doubling, tripling every year in size is not like, uh, you know, and I think today you kind of see that with LLMs too, where like every year the jumps in size and like capabilities are just so big.”
09 / belief
“Recently models and I think the release of them right after the new reps scaling instead talked by Ilia.”
10 / belief
“I think now you can start to infer semantics from things that are beyond just like simple recognition to like understanding why certain things are happening a certain way.”
11 / belief
“You know, in the, as anything changed, like since you, because you updated this in 2022 and I think now we're kind of like, you know, five years removed from COVID and all of that.”
12 / belief
“If I'm getting, you know, this in return, but that sort of should be my option. I think now with computer use, you can actually automate some of the exports.”
13 / belief
“I think the when I first said web search, I thought you were going to just expose a API that then return kind of like a nice list of thing.”
14 / belief
“I've run a lot of engineering teams in the past, and I think the product versus engineering tension has always been more about effort than like whether or not the feature is buildable.”
15 / belief
“Just as on the LLM usage, like the IPyMB file, it's just not good to put in LLMs. So just that alone, I think should be okay.”
16 / belief
“I think people maybe have gone the other way, which may get even more opinionated, like with X and like all these kind of like notebook companies.”
17 / belief
“I think that's kind of like the, that's the, you know, Sam is always talking about incremental deployments and kind of like getting, having people getting used to it.”
18 / belief
“Before we go into the inference, some of the deeper stuff, can you give people an overview of like some of the numbers? So I think last I checked, you have like 1.”
19 / belief
“Um, and so I think if you remove that whole, like, oh, that's impossible, and you just think really clearly about like, what's now possible with like what, what they've done with O1, it's easy to see how that scales.”
20 / belief
“I'm like, I'm sure there's not what event, you know, but I'm curious, like, just like how people there's always like this, I think for a little bit, it went away about like startups and kind of like hustle culture and like all of that.”
21 / belief
“I think to me, that's the most interesting thing about search today, like with Google and whatnot, it's like, it's mostly like domain authority.”
22 / belief
“I think most people start with automatic, and then they move over, and it's, like, snap, CFG, sampler, name, scheduler, denoise.”
23 / belief
“I think in AI you see this a lot, which is like a lot of stars, a lot of interest at a rate that you didn't really see in the past in open source, where nobody's running to start.”
24 / belief
“I think that's like one of the hardest things about NeurIPS. It's like the long tail.”
25 / belief
“I feel like this is almost like, you know, Now the agent thing needs to happen. And I think that's really the unlock.”
26 / belief
“I think all these episodes that are like [01:45:00] summarizing things that people care about, but they're disparate.”
27 / belief
“I think like a lot of AWS customers, you know, they do this big reserve instance contracts and now they got to use their money.”
28 / belief
“I think the point of the talk was like everybody, we're scaling these chips, we're scaling the compute, but like the second ingredient which is data is not scaling at the same rate.”
29 / belief
“Voice mode, yeah. I think most people have tried it by now. Because it's generally available.”
30 / belief
“OpenAI now needs then more money because they need to support those products and I think maybe their bet is like 1 billion we can get to the thing.”
31 / belief
“I think today small is actually a more nuanced discussion, you know, that people weren't really having before.”
32 / belief
“I mean, I'm curious, I think Dylan, At the debate he said SweetBench 80 percent was like a soap for end of next year as a kind of like, you know, watermark that the moms are still improving.”
33 / belief
“I think there's, you know, the whole gamut from very simple to like very complex.”
34 / belief
“How did you get, you joined Anthropic, did you already know you were going to work on of the stuff you publish or you kind of join and then you figure out where you land? I think people are always curious to learn more.”
35 / belief
“I think initially people were like, oh, maybe you're just getting lucky with XML.”
36 / belief
“I think maybe before it was like, hey, we need to set up OAuth that humans only want to kind of do once.”
37 / belief
“I think the people that are in San Francisco that were here before, tech hated it and then there's kind of like this passed down thing.”
38 / belief
“I think a post-mortem would be fun, but I don't think we need to do it on the podcast now.”
39 / belief
“I think the thing about ad-generated content, if we look at YouTube, like we do videos on YouTube and it's like, you know, a lot of people like screaming in the thumbnails to get clicks.”
40 / belief
“I think NTU is going to be one of the first universities to have these cyber ranges for like a AI red teaming training.”
41 / belief
“I think maybe a lot of people say, hey, things change so quickly, they're like trying to abstract things.”
42 / belief
“You obviously run Dropbox, which is a huge company, but you also do a lot of coding. I think that's how you spend almost 400 hours, just like coding.”
43 / belief
“I think that might be useful, but honestly, like, that would be nice to have when we have the time.”
44 / belief
“Then once you get to thought generation, people start to think, what is going on here? So I think everybody, well, not everybody, but people that were tweaking with these things early on saw the take a deep breath, and things step-by-step, and all these different techniques that the people had.”
45 / belief
“I think you've done a great job at grouping the types of mistakes that people make.”
46 / belief
“Just to set the timeline, when did each of these things came out? So Learn Prompting, I think was like October 22.”
47 / belief
“I think that's maybe the, not mistake, but like misunderstanding that people have when they think of NPCs.”
48 / belief
“Especially for newer folks that have like a lot more training data out there, so to speak. I think of like, you know, Sean Carroll.”
49 / belief
“I think the two episodes are six hours, so there's plenty to listen, we'll make sure to send it over.”
50 / belief
“I think to me, the most interesting thing has been hiring and some of the awesome people that you've been bringing on that maybe don't fit the central casting of Silicon Valley, so to speak.”
51 / belief
“How do you pass these things? But I think the problem with building frameworks is frameworks generalize things that we know work.”
52 / belief
“I think people are price craving late in space and we're not getting a dime. So that's what it is.”
53 / belief
“My first time here in Singapore, which has been really nice. This country is really amazing, I would say.”
54 / belief
“I think to me the biggest question about on-device, obviously there's a Gemini Nano which is getting shipped with Chrome.”
55 / belief
“I think the big problem, not a problem, but the price of the model comes out, and then people build on it.”
56 / belief
“I think people underestimate how important it is to be very good at doing something versus trying to serve everybody with some of these things.”
57 / belief
“I need to talk to that agent. You know, but I think nobody really cares about that today.”
58 / belief
“I think today it's mostly like LLM Rails, you know? Like there's no OS, but I think like actually helping people build things.”
59 / belief
“I think today people will be happy to trade 50 milliseconds to get higher quality output from a model.”
60 / belief
“I think maybe a lot of people initially wrote them off, but between some of the Gemini Nano stuff, like Gemma 2, PolyGemma, we'll talk about some of the KV cache and context caching.”
61 / belief
“I think now it's like every time Entropic releases something, people are like, okay, this is like a serious thing.”
62 / belief
“I mean, music industry and lawsuits, name a more iconic duel, you know, so I think that's to be expected.”
63 / belief
“I think we can maybe transition towards some of your personal stuff. We kept you here for a long time.”
64 / belief
“If you think about the evolution of the models, I think up until Llama3, with Meta AI and some of these things, I'm like, it makes sense that they want to build their own models and they're multi-modal.”
65 / belief
“I think folks were asking if you see that as an interesting direction to kind of having specific synthetic data generation things.”
66 / belief
“I think that's how one of your tweets, you trained on about 200 million tokens for the AP model to the context extension.”
67 / belief
“I think people that are watching Fallout on Amazon Prime right now can maybe feel nostalgia just looking at it.”
68 / belief
“I think people understand that with stable diffusion, you have these LoRa patches for different types of styles.”
69 / belief
“Any other things that you want to bring up, maybe how people are using gradient, anything like that, I think that will help have a clearer picture for people.”
70 / belief
“I think most people optimize for latency in a way, especially for like maybe the Diva archetype, you actually don't want to respond for a little bit.”
71 / belief
“People are running the same thing when they're building sales agents, when they're building customer support agents, like it all comes down to how do you make the thing sound like how you want it to sound? And I think most folks out there do prompt engineering, but I feel like you figure out something that is much better than a good prompt.”
72 / belief
“I think now the models also support like JSON mode and some of these things and, you know, return JSON or my grandma is going to die.”
73 / belief
“I think that's, that's like what I'm most interested to figure out because with the browsers, it's like, it's the entry point to the thing.”
74 / belief
“I think when you do a new Silicon, you're like, Oh, we're going to be so much better at this thing or like much faster, much cheaper.”
75 / belief
“I think like the, what is possible today and like what is worth investing in, you know? And I think like, I mean, people look at you and say, well, these guys are building agents.”
76 / belief
“How do you think about the pro market, so to speak? Because I think lowering the barrier to some of these things is great.”
77 / belief
“We've gone almost 30 minutes without making any music on this podcast. So, I think maybe we can fix that and jump into a demo.”
78 / belief
“Yeah, no, that's a I think that's a good point overall about AI generated anything, you know, because I think recently T-Pain, he did like a an album of covers.”
79 / belief
“I think to me the most interesting thing about long inference is like, You're shifting the cost to the customer depending on how much they care about the end result.”
80 / belief
“I think the last one we did, the four wars of AI, was the main kind of mental framework for people.”
81 / belief
“I think there's a lot of money that goes into building what GRUK has built as far as the hardware goes.”
82 / belief
“You know I think, I mean, obviously the Voyager paper is like the most basic example where like, now their artifact is like the best planning to do a diamond pickaxe in Minecraft.”
83 / belief
“I think the The challenge, well not the challenge, what they need to figure out is like how do you keep the rag piece always up to date constantly, you know, I feel like the models, you put all this work into pre training them, but then at least you have a fixed artifact.”
84 / belief
“One of the things that George mentioned is I think you have like 250 primitive operators in PyTorch, I think TinyGrad is four.”
85 / belief
“I think the issue I've seen with serverless has always been people really wanted it to be stateful, even though stateless was much easier to do.”
86 / belief
“I think maybe a year ago, people were like, oh, yeah, you can use this GPU computer that is going to be end-of-life.”
87 / belief
“Like this is a concept that I hadn't heard before reading about this. So I think most people's mental models, like transformers or something else, it’s not transformers AND something else.”
88 / belief
“When you were building retool vectors, how do you think about, yeah, leveraging a startup to do it, putting vectors into one of the existing data stores that you already had? I think like, you're really a quite large customer scale.”
89 / belief
“I think a lot of AI startups now are raising very large rounds and maybe don't know what to do with the capital.”
90 / belief
“You know, we're kind of looking at the wrong level of abstraction. Yeah, I think there's a lot of interesting philosophical discussions to have.”
91 / belief
“Obviously, there's like all these different things like privacy, you know, if an internal tool hallucinates, that's fine, because you're paying people to use it basically, versus if it hallucinates to your customer, there's a different bar. Because for you, if people build internal tool with retool, there are external customers to you, you know, so I think you're on the flip side of it.”
92 / belief
“I think people want to hear it. I think there's a lot of higher level explanations out there.”
93 / belief
“Another favorite topic of our listeners is UX and AI. And I think you're probably one of the best all-inclusive editors for these things.”
94 / belief
“I think the other interesting thing that you have is this inline assist UX that I wouldn't say async, but like it works while you can also do work.”
95 / belief
“I think everybody understands that it's a AI coding agent, but a lot of companies say they have a AI coding agent.”
96 / belief
“Uh, yeah, I think one of the things that Swyx said when he was opening the AI engineer summit a couple of weeks ago was like, look, most people here don't know much about the space because it's so new and like being open and welcoming.”
97 / belief
“I think the startup's point is the most interesting, right? You mentioned companies that are GPU poor, they raise a lot of money, and there's a lot of startups out there that are GPU poor and did not raise a lot of money.”
98 / belief
“To compare, like, S3 costs like 2 cents per month per gigabyte, so it's like 300x more, something like that, than just raw S3 storage. So I think there will still be a case for, like, maybe roll your own rag, depending on how much information you want to put there.”
99 / belief
“I think that would be quite, quite interesting. But yeah, I think a lot of excitement and, you know, we just announced the, the Linux based launchpad, so we're on the side of the, of the builders.”
100 / belief
“I think you have over 16,000 stars on GitHub today, you have a very active open source community.”
101 / belief
“I think now a big part of the wave is removing the need for data professionals to always be in the loop and having non-technical folks do more of the work.”
102 / belief
“The other thing I think about these models is like Swyx was at Airbyte and yeah, there's Fivetran.”
103 / belief
“You know, the data is not good for anything. And I think like now, at least with these models, they have some knowledge of their own and they can also tell you if your data is bad, which I think is like something that before you didn't have.”
104 / belief
“Now that's an important message. And yeah, that's why we've been promoting a lot of open source developers, open source communities, I think, letting the builders build and explore.”
105 / belief
“The difference I think at the Databricks keynote, you said chains are like predetermined steps and agents is models reasoning to figure out what steps to take and what actions to take.”
106 / belief
“You essentially have model memory, optimizer memory, gradient memory, and activation memory. I think that's one of the last discussed things.”
107 / belief
“I know we're at the hour mark, and I think we put our listeners through a very intense class today.”
108 / belief
“I think a lot of times the focus is on tokens parameter ratio in the training dataset and people don't think as much about the actual flops per GPU, which you're going to mention later in the blog post too, in terms of how much you can get out.”
109 / belief
“HBM keeps growing, HBM3 is going to be 2x faster than HBM2, I think the latest NVIDIA thing has HBM3.”
110 / belief
“I think you guys use the magic word, which is open source, and everybody has a, has a different, different definition.”
111 / belief
“I think to a lot of the AI engineers audience that we have, they're not as deep into the details of the papers.”
112 / belief
“You know, I think you wrote like, feels like ChatGPT wrote the movie and that's my worry a little bit.”
113 / belief
“I think you, right now the math was that for the price of the most expensive thing we build, which is the International Space Station, we could build one Tampa of.”
114 / belief
“I think the most interesting thing about hackathons is you come with an idea and then you kind of hit a wall trying to build it.”
115 / belief
“I think there's a lot of people that are excited about the technology and want to hack on things.”
116 / belief
“Sorry, Linus, this is unrelated, but I think you build over a hundred side projects or something like that.”
117 / belief
“I think there's a lot of people that have only been exposed to Copilot so far, which is one use case, just complete what I'm writing.”
118 / belief
“You know, we mentioned some of the podcasts you had done, Jonathan, I think in one of them you mentioned Mosaic was not planning on building a model and releasing and obviously you eventually did.”
119 / belief
“I think fast training in inference was like one of the goals, right? So there's always the trade off between doing the hardest thing and like.”
120 / belief
“I think the Expedia one said, please do not mention any other travel website on the internet.”
121 / belief
“I think he basically, apple was like, you gotta go [00:48:00] back to the office.”
122 / belief
“I think like the word on the street is like when GPT4 comes out, everything else is like trash that came out before it.”
123 / belief
“I was reading on Twitter, I think somebody was saying in the future will be kind of like in the hair potter word.”
124 / belief
“How do you see the engineer, I, I think Sean, you said copilot is everybody gets their own junior engineer to like write some of the code and then you fix it For me, a lot of it is the junior engineer gets a senior engineer to actually help them write better code.”
125 / belief
“Zero to like a million users in five days and everybody, I, I think there's like dozens of ChatGPT API wrappers on GitHub that are unofficial and clearly people want the product.”