Decentralized training has been cracked, and it happened on Akash
The Supercloud - by Greg Osuri, Akash (Cosmoverse)
“AI training has been traditionally very centralized, in the sense that you needed collocated clusters locally present to do any meaningful training. But that changed with Akash. Today we see companies like Nous Research, companies like Prime Intellect, that actually cracked decentralized training. The first billion parameter model by Nous Research was trained on Akash; [the] first 10 billion parameter model by Prime Intellect is being currently trained on Akash.” — 00:13:54
Context: October 2024 claim that decentralized training moved from theory to practice, with Akash “front and center.”