tool / likes
MyPie
“Now I like that. You know what does a good job at this? MyPie. I love MyPie. MyPie, this fancy type checker for Python.”
Public evidence record
Published podcast speaker
Books, apps, and tools
tool / likes
“Now I like that. You know what does a good job at this? MyPie. I love MyPie. MyPie, this fancy type checker for Python.”
book / recommends
“And if I recommended The Metamorphosis of Prime Intellect last time, there is a sequel called A Casino Odyssey in Cyberspace.”
book / recommends
“And if I recommended The Metamorphosis of Prime Intellect last time, there is a sequel called A Casino Odyssey in Cyberspace.”
person / built
“I'm going to build a box for Kama and then I'm going to show off the box I built for Kama and be like, okay, like, do you want to build?”
Claim ledger
65 transcript-backed records
01 / recommendation
“And if I recommended The Metamorphosis of Prime Intellect last time, there is a sequel called A Casino Odyssey in Cyberspace.”
02 / recommendation
“Now I like that. You know what does a good job at this? MyPie. I love MyPie. MyPie, this fancy type checker for Python.”
03 / belief
“I took a political approach at comma too, that I think is pretty interesting. I think Elon takes the same political approach.”
04 / belief
“We’re actually going to build that, I think, but it’s not going to be one static tape.”
05 / belief
“I think he does. And this is exactly what I mean and why I bet on him so much more than I bet on Google.”
06 / belief
“I actually think it’s incredible that we’re starting to see… I think, again, Elon’s doing so much stuff right with Twitter, like charging people money.”
07 / uncertainty
“You’ll see they’re all apples on the front page when you search Apple. And I don’t know.”
08 / belief
“Everything running in the universe is computation, I think. I believe the extended [inaudible 00:07:53] thesis.”
09 / belief
“Wow the little thing has learned to mimic. Then I realized that that’s all we are too.”
10 / observation
“We need to have one model that we control and align. This is the only way you end up paper clipped.”
11 / belief
“I think that Eliezer Yudkowsky is scared of these things. And I am scared of these things too.”
12 / uncertainty
“I don’t know. I downloaded the plugin maybe two months ago. I tried it again and found the same.”
13 / belief
“I think what’s going to happen is, okay. If you’re trying to make an AI accelerator, you better have the capability of writing a Torch-level performance stack on Nvidia GPUs.”
14 / belief
“Sure. I think the most obvious way to me is wire heading. We end up amusing ourselves to death.”
15 / belief
“I think that we’re going to get super scary memes once the AIs actually are superhuman.”
16 / belief
“If consciousness is a spectrum, I’m definitely way more conscious than the large language models are. I think the large language models are less conscious than a chicken.”
17 / belief
“You can read the code. I think the code is easier to read, it’s less lines. There’s just a few things about the way tinygrad writes things.”
18 / uncertainty
“I don’t know. I just think that that’s why it’s harder. Yeah, maybe it is my biases.”
19 / evaluation
“Oh, well, let’s start with the fact that the 7,900 XTX kernel drivers don’t work.”
20 / commitment
“You’re saying that, “Look, LLMs, and AI, and machine intelligence can cause a lot of harm, so nobody should have it.” And I will respect someone philosophically with that position, just like I will respect someone philosophically with the position that nobody should have guns.”
21 / uncertainty
“Oh, no. We don’t know what the ceiling is for the biostack either. The biostack just seems to move slower.”
22 / belief
“About a whole matrix coming at him. I think that’s Andrew Tate’s word for it. Sorry to borrow it.”
23 / uncertainty
“There’s so much hype, at least on Twitter. I don’t know. Maybe Twitter’s not real life.”
24 / belief
“I think you can define the ideal no more than just saying Elon’s idea of a good world, freedom of expression is.”
25 / belief
“I think future LLMs are going to be smaller, but are going to run looping on themselves and are going to have retrieval systems.”
26 / belief
“I think that there’s some things that are nicer about Tinygrad’s syntax than PyTorch, but their front end looks very Torch-like.”
27 / belief
“I don’t believe what anyone says. I believe incentives. If a company wanted to buy Comma with their incentives, were to keep it open source.”
28 / belief
“Look, I think Microsoft… Again, I wouldn’t count on it to be true forever, but I think right now, Microsoft is doing the best work in the programming world, between GitHub, GitHub Actions VS Code, the improvements to Python, it was Microsoft.”
29 / belief
“I’m like, yeah, you know what? I think in two years, I’m going to start using these plugins a little bit.”
30 / belief
“To be fair, do I think AI kills us all? I think AI kills everything we call society today.”
31 / observation
“Absolutely. It’s the only way. You think you’re going to control it. You’re not going to control it.”
32 / belief
“I mean, yeah. And I think that if someone is actually serious enough to hire a hitman or build a bomb, they’d also be serious enough to find the information.”
33 / belief
“Now, there’s a few things I think I do understand and know more about, but in general, I’m not qualified to run Twitter.”
34 / belief
“I think if you ask me, Google’s still the number one webpage. I think by the end of the decade Google won’t be the number one my bed anymore.”
35 / belief
“I think we dramatize everything. I think that you ask the milk man when he saw refrigerators.”
36 / belief
“Look, my prediction for TensTorrent is that they’re going to pivot to making risk five chips, CPUs.”
37 / belief
“Not people who believe that the saving the environment is good, I agree with you.”
38 / belief
“I mean okay, other two other games that I think are very noteworthy for me are Skyrim and GTA 5.”
39 / belief
“If the AI apocalypse happens, I mean the AIs are going to probably die out because I think we’re going to get, again, super intelligence long before we get robustness.”
40 / uncertainty
“I don’t know. I don’t know if it would upset God. I think he wants that. I mean, I certainly want that from my creations.”
41 / uncertainty
“I don’t know about AGI. I think we’re a long way away from that. But I would not be surprised, if in the next five years, Bing overtakes Google as a search engine.”
42 / observation
“The problem is if you go back to 1960 and you tell them that you have a machine that can play amazing chess, of course someone in 1960 will tell you that machine is intelligent.”
43 / belief
“I think things like MuZero and AlphaGo are so much more impressive because these things are playing beyond the highest human level.”
44 / belief
“I think that there’s a spectrum and on one side you have Mojo and on the other side you have ggml.”
45 / evaluation
“The chips were good, the software was terrible. Part of the reason is because I think the same problem’s happening with Dojo.”
46 / recommendation
“I think that you have to write a competitive machine learning framework in order to be able to build an ASIC.”
47 / preference
“I won’t even say this so cynically. I will actually say this in a way that I want AI friends.”
48 / evaluation
“” I’m like, “Oh, what do you mean time doesn’t exist?” I think time is a useful model, whether it exists or not.”
49 / prediction
“I think accelerationism is the only thing that’s ever lifted people out of poverty.”
50 / evaluation
“I do not think anarchy in the physical world is very good because I exist in the physical world.”
51 / evaluation
“I think Scala has some beauty that Kotlin lacked, whereas Kotlin felt a lot more… I mean, I don’t know if it actually was a response to Swift, but that’s kind of what it felt like.”
52 / belief
“I want to make sure that can't happen structurally. So that's why I realized that it's really important that I do this.”
53 / recommendation
“I'm going to build a box for Kama and then I'm going to show off the box I built for Kama and be like, okay, like, do you want to build?”
54 / belief
“I think the best chatbot models are going to be the ones where you had a thousand training runs instead of one.”
55 / belief
“Like, we'll just, I think, think of it as maybe more of, like, a stipend than a salary.”
56 / belief
“Coming back to what I think is actually gonna happen is, yeah, people are gonna train smaller models for longer and fine-tune them and find all these tricks.”
57 / evaluation
“That's, I mean, that's one of them where, like, I really, I put a lot of effort into CI for TinyGrad. I think CI is super important.”
58 / prediction
“I think the right answer is something that looks more like queues that feed into ALUs, and then you can prefetch the loads from the memory, put in a bunch of queues, and then the queue is just like, and feeds into another queue over here.”
59 / prediction
“We have better support for ONNX than Core ML does. And we're going to have, I think we're going to pass ONNX Runtime soon, too.”
60 / prediction
“They're excited about reduced instruction set processors. So TinyGrad is, we are going to make a RISC offset for all ML models.”
61 / evaluation
“0. No PCIe extender I've tested, and I've bought 20 of them, works at PCIe 4.0. So you're going to need PCIe re-drivers.”
62 / evaluation
“No one does, of course, because it's so difficult, right? Like, actually, NVIDIA used to, I think CUDA 9 was the last one that had it.”
63 / evaluation
“It's all eventually going to be fused into one massive. So to say computer vision is solved, well, it doesn't make any sense because what's the output of a computer vision model?”
64 / commitment
“Okay, you've shown that it's worth my time, and I will put my time in because, like, let's make this better.”
65 / evaluation
“Because even the lines to express the, well, you can't use the where operator in PyTorch.”