A state-of-the-art model trained over the internet within 12 months
The Truth About Decentralized AI and the Future of Compute (TEACHMEDEFI)
“In terms of training — not there yet. We are able to train, using home computers, about 7 billion parameter models now — still very small — but the models are getting bigger and bigger and more efficient. In terms of training, I’m pretty sure in the next 12 months we’ll see a state-of-the-art model trained over the internet using heterogeneous methods.” — 00:11:36
Context: Quantified, dated forecast (Dec 2025 → end of 2026) on decentralized training across consumer hardware.