Public evidence record
Published podcast speaker
Claim ledger
32 transcript-backed records
01 / belief
“I think I was the most boring normie liberal in the world before encountering LessWrong.”
02 / belief
“I think that’s kind of why all of our policy prescriptions are things like more transparency, get more people involved, try to have lots of people working on this.”
03 / belief
“I actually argued with Daniel about this recently about one interesting case that I can go over is we have an estimate that about a year after the superintelligences start wanting robots, they’re producing a million units of robots per month. I think that’s pretty relevant because you have.”
04 / uncertainty
“Now I could never handle that schedule, I don’t know, I was in my 20s, I must have been briefly superhuman.”
05 / belief
“If you can create a country of geniuses in a data center, as I think Dario Amodei put it, then you no longer have this population bottleneck, and you’re just expecting continuation of those pre-1960 trends.”
06 / belief
“Here it was a prompt, but I think very soon it’s going to be the spec where it’s more of an agent and it’s understanding the spec on a deeper level and just thinking about that.”
07 / evaluation
“Henrich is talking about this very unfair comparison where these guys have a 50,000 year head start and then you put this guy in, “oh, I guess this doesn’t help that much.”
08 / prediction
“We expect that as the AI labs become more capable, they tell the government about this because they want government contracts, they want government support.”
09 / belief
“I think if you were able to avoid that maybe by using the base model, maybe by using some kind of really good prompt to be like, “no, do this in Gwern’s voice”, you would get something that was pretty good.”
10 / uncertainty
“I think that with Situational Awareness, I don’t know how much publicity Leopold put into it.”
11 / belief
“Trying things can be anything from trial and error without even understanding the scientific method, without understanding writing, maybe without even having language and having to be the chimpanzees who are watching the other chimpanzees use the stick to get ants, and then in some kind of non-linguistic way this spreads, versus like the people at the top aerospace companies who are running a lot of simulations to find the exact right design, and then once they have that, they test it according to a very well designed testing process. So I think if we get the ASI and it does end up with the Dyson sphere in five years- and by the way, I think there’s only like 20% chance things go as fast as our scenario says.”
12 / uncertainty
“Everyone is still talking about Applied Divinity Studies, who hasn’t written, unless I missed something, hasn’t written much in a couple of years. I don’t know.”
13 / belief
“Partly they do it because they’re in this hive mind of hundreds of thousands of copies. But yeah, I think if you have this data efficiency such that you can learn things more quickly from fewer examples and this good research taste where you can decide what things to look at to get these examples, then you are still going to start off much worse than an Australian Aborigine who has the advantage of, let’s say 50,000 years of doing these experiments and collecting these examples.”
14 / belief
“We could have a different copy of the superintelligence optimizing every single part full-time. I think that’s just a really big speed up.”
15 / uncertainty
“The same trend that has caused us to have a thousand times speed up multiplier relative to past eras and not even the Paleolithic, like what happened in the century between, I don’t know, 600 and 700 A.”
16 / belief
“I think if you were to force the AI to do this in a reasonable way, or you were to train the AI such that it itself could come up with the plan of going through this in some kind of heuristic-laden way, you could potentially equal humans.”
17 / uncertainty
“I don’t know what percent of people who start a blog end up making enough that they can quit their day job.”
18 / belief
“I think again, in this world where everything goes perfectly and we have limitless prosperity, I think that just the default of limitless prosperity is that people do mindless consumerism.”
19 / belief
“I think with race, it’s very easy to know whether you’re black or white, and so there have been many cases of one race kind of conspiring against another for a long time, like apartheid or any of the racial genocides that have happened.”
20 / belief
“People are going to read your blog. That, I think is one thing, is people are just afraid no one will read it, which is probably true for most people’s first blog.”
21 / belief
“Again, that may turn out to be wrong, but it does look like the Metaculans overall have, have been too pessimistic, thinking too long term rather than too optimistic. And I think that’s like the closest thing we have to a neutral aggregator where we’re not cherry picking things.”
22 / belief
“I think you make a great point that discoveries don’t always come from where we think, like Nvidia originally came from gaming.”
23 / uncertainty
“I feel like if I had started a blog in 2000 or something, then- I don’t know, I’ve done well for myself, I can’t complain- but the people from that era all founded news organizations or something.”
24 / belief
“There are many, many times more people who have written good books than who are actively operating great bloggers right now, I think.”
25 / belief
“I think there’s more opportunity for pliability there. Because humans were, of course, evolving under this genetic imperative that we want to pass on our own genetic information, not somebody else’s genetic information.”
26 / prediction
“Wait a second, I’m a little confused to hear you say that, because when I have seen people predicting AI milestones like Katja Grace’s expert surveys, they have almost always been too pessimistic from a point of view of how fast AI will advance.”
27 / prediction
“If you have a physics simulation available, then all of these real world bottlenecks don’t matter as much.”
28 / prediction
“Our scenario focuses on coding in particular because we think coding is what starts the intelligence explosion.”
29 / prediction
“We’re telling it “succeed on tasks, which is going to make you a power seeker, but also don’t seek power in these particular ways”. And in our scenario, we predict that this doesn’t work and that the AI learns to seek power and then hide it.”
30 / recommendation
“I don’t think you would use one of the human ones because you would want something that was better suited for this task.”
31 / evaluation
“There’s just a constant reactive attempt to protect jobs in the most venial possible way. So things like the longshoremen union we have now where they’re making way more money than they should be, even though they could all easily be automated away, because they’re a political bloc and they’ve gotten somebody in power to say, “yes, we guarantee you’ll have this job almost as a feudal fief forever”.”
32 / evaluation
“First of all, I agree if there’s only one way to do something that makes it much harder, and maybe that one way takes very long, we’re assuming that there may be more than one way to cure cancer, more than one way to do all of these things, and they’ll be working on finding the one that is least bottlenecked.”