Distributed training is at its GPT-2 moment
"DACM Insights: Decentralizing AI, The Akash Approach" (DACM Insights)
“We, as a distributed training landscape, are maybe at a GPT-2 level in terms of our technological progress… that’s going to take some time and some resources and incentives. My big question is not the technology — it’s what is the incentive for someone to provide the compute to train a model… and I think that’s where we’re entering the crypto AI space, and where Akash fits in — the infrastructure layer for the entire thing.” — 00:14:39
Context: Positioning crypto incentives as the missing piece for distributed training; leads directly into the home-node discussion.