service / recommends
3Blue1Brown
“One takeaway I had from reading and watching your stuff on the cosmic distance ladder… By the way, I highly recommend people watch your series with 3Blue1Brown on the cosmic distance ladder.”
Public evidence record
Host · Dwarkesh Podcast
Books, apps, and tools
service / recommends
“One takeaway I had from reading and watching your stuff on the cosmic distance ladder… By the way, I highly recommend people watch your series with 3Blue1Brown on the cosmic distance ladder.”
book / uses
“The thing I find wild when I'm reading The Prize is just how much economic development is ultimately contingent on the laws of physics.”
book / recommends
“You have this really interesting book, I think probably my favorite book about World War II, The Storm of War, which I highly recommend.”
book / recommends
“Yeah, I totally agree. I don't want to repeat myself, because I talked about this on my Byrne episode but we were talking about Robert Caro's books and one interesting thing is this guy was nominated for a Pulitzer Prize before he wrote The Power Broker. He was a top tier investigative journalist. Can you imagine crunching the numbers as a top tier investigative journalist at the peak of your career and you're like, “You know what would be a good use of my time? I'm going to spend the next seven years, in almost poverty, writing about this one guy who had a lot of influence in New York. I'm going to talk to any person who had conceivably even been in the same room as him or had been indirectly affected by his policies in any way. And I'm gonna do that obsessively for the next seven years.” There's no way the number crunching would get you there but it's probably been one of the most influential books in terms of how urban governance is done. Presidents have praised and read the book and said it changed how they think about politics. It is the kind of thing where you wouldn't have gone to that conclusion just from thinking about it beforehand and this is the most effective thing I could do.”
book / recommends
“Your most recent book is Survival of the City. And before that Triumph of the City, both of which I highly recommend to readers.”
Claim ledger
99 transcript-backed records
01 / uncertainty
“I don’t know. But it would be many hundreds of billions of dollars per gigawatt if you get full AGI.”
02 / uncertainty
“We just don’t have human-level robotics models yet. So you’re suggesting if we do that — if the AIs get really good at the verifiable stuff in chip design, et cetera, and then they get really good at building fabs — it’ll be the equivalent of going back to the 18th century and saying, “Okay, I don’t know what you guys are talking about in your parliament, but I’ve got a bunch of steamships and a bunch of Maxim guns.”
03 / uncertainty
“As you were saying, by the time RLVR actually worked — even though you could have done it with less compute — we had to wait for oceans of compute, gigawatts of compute, to be available before people were doing this training, on the trajectory of compute continuing to increase so we make more breakthroughs. I don’t know.”
04 / uncertainty
“As you were saying, GR explains or predicts a lot of phenomena. Some we think are correct, some we don’t know are correct.”
05 / uncertainty
“When the AI came up with that counterexample to the unit distance conjecture, you can just read its chain of thought. It’s not understandable to me, because I don’t know anything about mathematics, but it seems that to other mathematicians it was understandable.”
06 / uncertainty
“I’ve only read, obviously, the translation, so I don’t know what it’s like in the original Italian.”
07 / uncertainty
“I don’t know if you have any commentary on what the brain might be doing versus how these chips work.”
08 / uncertainty
“Interesting. But we don’t know what exactly happens, if anything, between 200,000 years ago and 50,000 years ago that goes from just anatomical modernity to behavioral modernity.”
09 / uncertainty
“I don’t know if it’s still correct, but as of a month ago you said that there had been a pause because the low-hanging fruit had been picked.”
10 / uncertainty
“When did ASML start shipping EUV tools, when 7 nm started? I don’t know when that was exactly.”
11 / uncertainty
“If we end up in this world in 2030 where the West has the most advanced process technology but has not ramped it up as much, whereas China… I don’t know if you think by 2030 they would have EUV and 2 nm or whatever.”
12 / uncertainty
“I mean the message I’m taking from this interview is that like all these people that folks make fun of on Twitter, Yann LeCun and Beff Jezos and whatever, I don’t know maybe they got it right.”
13 / uncertainty
“You had this previous lecture that you gave on the Indo-Pakistani chapter in history where we had to alienate India in order to fend off against the Soviet Union in this little episode. I don’t know what the solution to this is.”
14 / uncertainty
“To spell out what I mean—I don’t know whether it’s more accurate to call it a value function or reward function—but the brainstem has a directive where it’s saying, “Mate with somebody who’s more successful.”
15 / uncertainty
“I want to ask about your, I don’t know if you call it a prediction but, your hypothesis that at some point China and Russia will finish each other off or have some sort of conflict which will be bad for both of them.”
16 / uncertainty
“Then adults are somewhere in between, where they don’t have the flexibility of childhood learning, but they can memorize facts and information in a way that is harder for kids. I don’t know if there’s something interesting about that spectrum.”
17 / uncertainty
“I’m not trying to kickstart this initial crux again, but I’m just genuinely curious because I think I might be using the term differently.”
18 / uncertainty
“I don't know if there was an episode like this in the training set, but just for fun I took one of the shorts and turned it inside out.”
19 / uncertainty
“” I don't know if people usually put it this way, but it actually just seems extremely similar.”
20 / uncertainty
“I'm not sure how to understand this claim that we know how to engage with the right hook, we just don't know what that hook is supposed to do in the body. I don't know if that's the way you describe it.”
21 / uncertainty
“At current hardware efficiencies. I don't know if it's worth spelling out. Basically, an H100 has the same amount of flops as a human brain, but also uses way more energy than a human brain.”
22 / uncertainty
“To the extent that we hold consumption constant, and maybe we shouldn't, they would have to be suffering 4x as much as a chicken in the 1950s for it not to be a net improvement. I don't know if you disagree with that.”
23 / uncertainty
“Today I have the pleasure of interviewing George Church. I don't know how to introduce you.”
24 / uncertainty
“I don't know how the load balancing thing works, but that just seems like maybe you could try it out and see what happens.”
25 / uncertainty
“I don't know if that's the way you would still describe the way in which these software agents aren't able to do a full day of work, but are able to help you out with a couple minutes.”
26 / uncertainty
“If you're on your job, you're getting very explicit feedback from your boss. That's not necessarily how the task should be done differently, but a high-level explanation of what you did wrong, which you update on not in the way that pre-training updates weights, but more in the… I don’t know.”
27 / uncertainty
“I don't know, the fact that it's so hard to define it makes me think it's maybe a silly objective to begin with.”
28 / uncertainty
“Sometimes it goes off the rails, obviously, but I don't know… You could make a theoretical argument that you teach a kid to make a lot of money when he grows up and a lot of smart people are imbued with those values and just rarely become psychopaths or something.”
29 / uncertainty
“There was a really interesting paper. I don't know if you saw this. Humans think at 10 tokens a second.”
30 / uncertainty
“I don't know if it's a plausible explanation that cheap slave labor reduced the incentives for mechanization and engineering and other crafts or if not.”
31 / uncertainty
“A previous guest of mine, Nat Friedman, I don’t know if you saw this, launched this challenge called the Vesuvius Challenge.”
32 / uncertainty
“Let me just add on to that, one of the many other reasons why I worry about nationalization or some kind of public private partnership, or even just very stringent regulation- actually, this is more an argument against very stringent regulation in favor of safety rather than deferring more to the labs on the implementation- is that it just seems like we don’t know what we don’t know about alignment.”
33 / uncertainty
“I don’t know if ‘emotionally’ is the right word, but their expectation of what their life might look like, even in the world where there’s no doom.”
34 / uncertainty
“Actually, when we did our episode together, a bunch of people, I don't know if you saw this, independently made these blog posts and Anki cards and shit where they're explaining the concept because we just kind of passed over some things.”
35 / uncertainty
“The human brain can store much more, so why does the human brain just not want us to memorize these kinds of things, and is actively pruning, and… yeah, I don't know.”
36 / uncertainty
“The humans have in fact done this, and I don't know of a single example of LLMs ever having done it.”
37 / uncertainty
“Here’s another thing that I want to clarify: If you were trying to understand Britain's conduct in World War I, why they initiated it and why they conducted it in the way they did, and you tried to understand it using cultural explanations — what some British guy wrote in the 17th century — I don't know how far you'd get.”
38 / uncertainty
“I'm not sure if you're suggesting in the physical universe or in some hypothetical universe where the vacuum could be different, as in, in reality there are other pockets with different vacuums, or that hypothetically they could exist, or that our universe counterfactually could have been one of these? I don't know.”
39 / uncertainty
“I don’t know. When I look at the ways in which my smart friends are smart, it just feels more like a general horsepower kind of thing.”
40 / uncertainty
“Borges has a short poem called "Borges and I" where he talks about how he doesn’t identify with the version of himself that is actually doing the writing and publishing all of this great work. I don’t know if you identify with that at all.”
41 / uncertainty
“Another is NVIDIA. I don’t know how this works. Presumably, they have some sort of know-how.”
42 / uncertainty
“How are you doing research and making a video twice a week? I don't know. I do these, I'm just fucking talking.”
43 / uncertainty
“Millions of barrels of crude are being pumped out every year. I don't know if there's been any deployment like that since.”
44 / uncertainty
“I imagine since you wrote The Prize, world leaders are inviting you to meet them and give advice. I don't know how many stories you can tell from these conversations.”
45 / uncertainty
“I don't know if you're familiar with Nat Friedman's Vesuvius Challenge. I don't know if you saw that when it was going around.”
46 / uncertainty
“We figured out the exact genetic combination that explains all your research. Is the reaction usually… I don't know how much of this you can say.”
47 / uncertainty
“I don't know if species is the right word, but there were two different kinds of Denisovans and also the hobbits in Asia.”
48 / uncertainty
“" An adult in prison has that ability in a way that I don't know if these models necessarily have.”
49 / uncertainty
“” Going to college or meeting new people or reading a new book, I'm like, “I don't know.”
50 / uncertainty
“We're starting off with something that has this intricate representation of human values and it doesn't seem that hard to sort of lock it into a persona that we are comfortable with. I don't know what changes.”
51 / uncertainty
“I don't know if moral realism is the right word, but you mentioned the thing. There's something that makes hearts converge to the thing we are or the thing we would be upon reflection.”
52 / uncertainty
“Honestly, I don't know where to begin with some of these things. I want to understand a bunch of that.”
53 / uncertainty
“” I'm thinking to myself, how is this not as trivial a problem as, “hey XYZ, if you give me money that you can find between your couch cushions, we will save thousands of lives and get the world economy back on track.”
54 / uncertainty
“Maybe you have a point. We don’t know. You have arguments for why that’s a more likely world, but maybe that’s not the world we live in.”
55 / uncertainty
“Looking internationally, I don't know if Xi Jinping sees the GPT-4 news and goes, "oh, my God, look at the MMLU score on that.”
56 / uncertainty
“Although it's doing that by… I don't know. ChatGPT is probably modeling me because that's what RLHF induces it to do.”
57 / uncertainty
“I don't know if permanent is the right word, but they are the model itself whereas activations are the artifacts of any single call.”
58 / uncertainty
“I guess if you think of something like the laws of physics, it's not that the feature for wetness is turned on, but it's only turned on this much and then the feature for… I guess maybe it's true because the mass is like a gradient and… I don't know.”
59 / uncertainty
“There's some process by which to interpret the early data. I don't know. I could put a Google Doc in front of you and I'm pretty sure you could just keep typing for a while on different ideas you have.”
60 / uncertainty
“Is that the same kind of thing that's happening to ChatGPT when it gets RL-ed? I don't know.”
61 / uncertainty
“There was an interesting paper that you can use diffusion to come up with model weights. I don't know how legit that was or whatever, but something like that.”
62 / uncertainty
“There’s a perception that maybe other labs are more compute-efficient than DeepMind has been with Gemini. I don’t know what you make of that perception.”
63 / uncertainty
“I don’t know. We’re in Washington. I’m sure you talk to all the people who matter quite a bit.”
64 / uncertainty
“Given that, I don’t know, some of these risks pay off that these intellectuals take, some of them don’t pay off.”
65 / uncertainty
“I want to go back to the risk aversion thing again, because I don’t know how to think about this.”
66 / uncertainty
“I guess he could have talked about it if he wanted to, but I don’t know if he was.”
67 / uncertainty
“Yeah, but it seems like I don’t know how you train a John von Neumann, because then he also assisted the US in thinking about Cold War game theory and things like that.”
68 / uncertainty
“Another analogy here is it set up all these things that nobody understands, these systems of alliances and relationships in Europe. And you can imagine, like an AI advisor, and you’re not sure what’s going on, but it’s making, I don’t know, maybe it’s like a hedge fund manager that’s AI and it’s like making a lot of money.”
69 / uncertainty
“Whether it’s political modeling, whether it’s the use of new technologies, or I don’t know, testing things out with social media.”
70 / uncertainty
“Might be like Rlhf where we don’t know if it generalizes, but so far it makes your chat GPT thing better and you can also use it to make sure that chat GPT doesn’t tell you how to make a bioweapon.”
71 / uncertainty
“I don’t know, like computer security and code checking. If you can actually say this is how safe we think a code is.”
72 / uncertainty
“Presumably you didn't have some sort of practice but since you were encountering these things day to day, that natural frequency and way in which problems came up, did you have a worse understanding of those problems then compared to now, knowing what you do and having the practices you do, you're able to comprehend now? I don't know if that question made sense.”
73 / uncertainty
“If you are trying to self learn and there is a resource that is a close approximation of the syllabus you want. Should you just think “Hey, I don't know why I need this chapter.”
74 / uncertainty
“I don't know how many people were working on it when he became president, but hundreds of thousands of people are working on it.”
75 / uncertainty
“I don’t know. It wants to keep us as a zoo the same way we keep other animals in a zoo.”
76 / uncertainty
“I don’t know enough about how the RNN would be integrated into the thing, but that sounds plausible.”
77 / uncertainty
“I don’t know if I see the computer science of that, but I think I probably understand.”
78 / uncertainty
“Possibly but again, this is something that seems like, I don’t know the probability on it but I would put it at least 10%.”
79 / uncertainty
“I still think even most smart humans in that situation might disagree, but we don’t know what would happen in that situation.”
80 / uncertainty
“I’m not even making a moral point. I’m just saying I don’t know what’s going to happen in the future.”
81 / uncertainty
“The way you describe it, it seemed kind of compelling. I don’t know why that doesn’t even rise to 1%.”
82 / uncertainty
“From reading your writing from earlier, it seemed like a big part of your argument was like, look — I don’t know how many total mutations it was to get from chimps to humans, but it wasn’t that many mutations.”
83 / uncertainty
“I don’t know if you saw his recent blog post, but here’s a quote from it: “If you really accept the practical version of the Orthogonality Thesis, then it seems to me that you can’t regard education, knowledge, and enlightenment as instruments for moral betterment.”
84 / uncertainty
“For example, with California YIMBY, I don't know the exact amount you seeded it with.”
85 / uncertainty
“A lot of them might have, like, problems, to put it in that kind of language, but I don't know how many of them would make you suspect that there's, like, mental health issues or there's addiction issues that for somebody who's in charge of a multibillion dollar empire, I don't know.”
86 / uncertainty
“I was like ten in 2011 so I don’t know if I would’ve personally. I would’ve liked to think I would’ve caught on if I was older but maybe not.”
87 / uncertainty
“I don't know how to look into the far future situation, don't understand the far future situation, and don't see a path to doing good on that front I feel good about.”
88 / uncertainty
“I don't know if this is a hypothetical where that would happen, but let's just say that it is.”
89 / uncertainty
“First, how can somebody be long AI but hedge for the possibility that Taiwan will be invaded? So, I don't know if I should put money into TSMC but I know that GPUs are going to be the next big thing or are going to be very important in the future.”
90 / uncertainty
“If there's one person who's designing all the bridges, all the highways, all the parks, is something more possible that can be possible if like multiple different branches and people have their own unique visions? I don't know if that question makes sense.”
91 / uncertainty
“I don't know if you're familiar with the longtermist movement, maybe you’ve come across this before, but one thing they've proposed is not like a doctrine or anything, but on the periphery, some idea I saw was that just as we have environmental review we should have a posterity review so that you're analyzing the impacts of your actions on generations way down the line.”
92 / uncertainty
“I don't know if we discussed this, but an interesting part of the book is where he talks about transistor design.”
93 / uncertainty
“I have a friend who was with you at the Oxford Refugees Conference, Connor Tabarrok. I don't know if you remember him.”
94 / uncertainty
“I don't know if you saw this, by the way, but about a year or two ago, Microsoft announced that they were building this new office for developers in India and they were looking at this very interesting architectural details and craftsmanship that made it look like you know for everything from the furniture to the floor layout to the arches of the entrances.”
95 / uncertainty
“I don't remember. I don't know if you asked him directly, but that was his claim.”
96 / uncertainty
“I don’t know, but maybe yes. More generally, one of the common arguments that libertarians make about India and its elites is, “Oh, all of India's elites go study in Oxford or something, and they learn about the regulations the West is adopting that make no sense for a country with $2,000 GDP per capita.”
97 / uncertainty
“I don't know too much about it, but I hear that the Silk Road stuff they're doing is not especially economically wise.”
98 / uncertainty
“” I don't know; my perception of the story was, “Okay, he's not intelligent enough to be a theoretical physicist.”
99 / uncertainty
“I wonder whether he was doing this in the 40’–– like when he was at that age, was he doing this? I don't know what the cultural conventions were at the time.”