The fix is changing the math: 875x less communication
Solving AI's Energy Crisis with Decentralized Compute, w/ Akash CEO Greg Osuri (The People's AI: The Decentralized AI Podcast)
“Can we actually reduce the amount of energy bandwidth that’s needed between nodes?… They were able to reduce communication or improve bandwidth requirements by 875x. So from, I think, like 80 gigabytes to, like, 70 megabytes.” — 00:14:16
Context: Surveying low-communication optimizers: DeepMind’s DiLoCo paper (Whisper: “DialaCo”), Prime Intellect’s fully decentralized 10B-parameter model, and Nous Research’s DisTrO (Whisper: “News Research”). First quoted sentence is at [00:13:22].