Home computers will beat data centers as models optimize
From AWS to Akash: Greg Osuri on Building a Decentralized Compute Marketplace (Smart Economy Network)
“I’m a lot more convinced that as the models get more optimal in terms of training, you have higher chances of succeeding from a home-based computer than a data center based computer.” — 00:39:17
Context: Transitioning into heterogeneous distributed training (Pluralis) that lets mixed nodes big and small train together efficiently.