Dylan Patel: belief

Transcript context

…Yeah. You have to make sure to close all security vulnerabilities. So you, Dylan, collect a lot of information about each of the mega clusters for each of the major AI companies. Can you talk about the buildouts for each one that stand out? Yeah. I think the thing that’s really important about these mega cluster buildouts is they’re completely unprecedented in scale. US data center power consumption has been slowly on the rise and it’s gone up to 2, 3% even through the cloud computing revolution. Data center consumption has a percentage of total US, and that’s been over decades of data centers, etc. It’s been climbing slowly, but now, 2 to 3%. Now, by the end of this decade, it’s… Even under… When I say 10%, a lot of people that are traditionally by 2028 to 2030, people traditionally non-traditional data center people, that’s nuts. But then, people who are in AI who have really looked at this like the Anthropics and OpenAI’s, are like, “That’s not enough.” And I’m like, “Okay.” But this is both through globally distributed or distributed throughout the US as well as centralized clusters. The distributed throughout the US is exciting and it’s the bulk of it. Like, hey, OpenAI or, say, Meta’s adding a gigawatt, but most of it is distributed through the US for inference and all these other things. So maybe, we should lay out what a cluster is. So, does this include AWS? Maybe, it’s good to talk about the different kinds of clusters. What you mean by mega clusters? What’s the GPU and what’s a compute or… And what [inaudible 03:37:41]-…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.