Distributed training got solved three months ago — on Akash
Greg Osuri, CEO of Akash Network, on why compute should be shared with a decentralized marketplace! (LegendsNLeaders)
“Training has been predominantly collocated… but that was until about 3 months ago… Prime Intellect, Nous Research… created by former Google DeepMind, big AI lab employees — they’ve solved distributed training fairly well. Now we have a 10 billion parameter model that’s fully distributed, training across the internet. There’s a 15 billion parameter model by Nous starting training in a couple of weeks — and they all use Akash. That’s how I know about these things.” — 00:13:25
Context: The technical unlock he says makes deconcentration viable, referencing early-2025 distributed training runs.