Federated learning on distributed clusters is live via Prime Intellect and DiLoCo
[Solo Talk] Decentralization is saving AI where centralization failed by Greg Osuri (Kryptoplanet[Official])
“We had Prime Intellect that did an integration with Akash and doing federated learning, based on a new paper called DiLoCo, which is by Google DeepMind, that really talks about how can you do heterogeneous training on distributed clusters… and running on Akash right now.” — 00:14:21
Context: Presented as evidence decentralized training is becoming practical on heterogeneous, distributed compute.