# Decentralized training research is promising

- **Speaker:** Greg Osuri
- **Attribution:** attributed
- **Said:** 2024-06-09
- **Theme:** Decentralized AI — https://www.gregosuri.com/predictions/decentralized-ai/
- **Source:** Akash Accelerate '24: Official Recap (Akash Network)
- **Watch at:** 01:08:14 — https://www.youtube.com/watch?v=fVYeAVvuNLI&t=4094s
- **Canonical:** https://www.gregosuri.com/predictions/decentralized-ai/2024-06-09-decentralized-training-research-is-promising-ltdc/
- **Cite as:** Greg Osuri, "Decentralized training research is promising," Akash Accelerate '24: Official Recap (Akash Network), 9 Jun 2024, 01:08:14. https://www.youtube.com/watch?v=fVYeAVvuNLI&t=4094s

## Quote — verbatim

> I think we've been seeing a lot of progress in the decentralized training space. I'm very, very positive, especially a lot of the research papers that are coming out, like DiLoCo and whatnot, that propose training on heterogeneous, heavily distributed compute — seems to be promising.

## Context — site annotation, not spoken

Greg responding to Eric Voorhees' warning that if decentralized training isn't solved before Meta stops releasing open models, "we have a possibly very dystopian future."