Training compute is scaling to gigawatt clusters — it is going to be nuclear
Akash Network's Greg Osuri on AI Fueling 1,729% Growth (Coinage)
“GPT-4 was trained I believe on a 100 megawatt capacity data center, and that grows to about [2]50 megawatt capacity for the newer model… and the next tier is 1.2 gigawatt. When you get to 1.2 gigawatt, that means it’s a nuclear reactor — nuclear reactor produces 1 gigawatt. We can’t do solar… we just don’t have enough storage capacity for solar. So it is going to be nuclear, and Microsoft just bought a nuclear reactor in Pennsylvania.” — 00:17:23
Context: He says power needed for AI grows by roughly half an order of magnitude per year, and notes Oracle’s reactor plans and banks financing nuclear — “such an opportunity right now to decentralize power.”