# Federated learning on distributed clusters is live via Prime Intellect and DiLoCo

- **Speaker:** Greg Osuri
- **Attribution:** attributed
- **Said:** 2024-07-22
- **Theme:** Decentralized AI — https://www.gregosuri.com/predictions/decentralized-ai/
- **Source:** \[Solo Talk\] Decentralization is saving AI where centralization failed by Greg Osuri (Kryptoplanet\[Official\])
- **Watch at:** 00:14:21 — https://www.youtube.com/watch?v=YAOp0b8Bb6k&t=861s
- **Canonical:** https://www.gregosuri.com/predictions/decentralized-ai/2024-07-22-federated-learning-on-distributed-clusters-is-live-wobc/
- **Cite as:** Greg Osuri, "Federated learning on distributed clusters is live via Prime Intellect and DiLoCo," \[Solo Talk\] Decentralization is saving AI where centralization failed by Greg Osuri (Kryptoplanet\[Official\]), 22 Jul 2024, 00:14:21. https://www.youtube.com/watch?v=YAOp0b8Bb6k&t=861s

## Quote — verbatim

> We had Prime Intellect that did an integration with Akash and doing federated learning, based on a new paper called DiLoCo, which is by Google DeepMind, that really talks about how can you do heterogeneous training on distributed clusters... and running on Akash right now.

## Context — site annotation, not spoken

Presented as evidence decentralized training is becoming practical on heterogeneous, distributed compute.