Centralized AI training hits an energy cap in two years
Why the Future of AI Depends on Decentralized Cloud Platforms (Eye on AI)
“Using synthetic data and using mixture of experts mechanism you can actually solve the data problem, but what we cannot solve is the energy problem. That’s why it’s very, very important, if you’re doing training, to focus on distributing your training runs versus trying to go with the traditional mechanism of centralizing your training runs… because we’re going to hit a cap in two years and we have no solutions.” — 00:55:53
Context: His closing thesis (also the cold open): DeepSeek proved synthetic data removes the data ceiling, leaving energy as AI’s binding constraint; $500B in announced investment goes to power infrastructure that will arrive too late.