# Distributed training over the internet just became real

- **Speaker:** Greg Osuri
- **Attribution:** attributed
- **Said:** 2025-04-02
- **Theme:** Decentralized AI — https://www.gregosuri.com/predictions/decentralized-ai/
- **Source:** Interview With Greg Osuri, Founder Of Akash Network (Secret Network)
- **Watch at:** 00:20:58 — https://www.youtube.com/watch?v=k0HPDluOlsQ&t=1258s
- **Canonical:** https://www.gregosuri.com/predictions/decentralized-ai/2025-04-02-distributed-training-over-the-internet-just-became-w7ms/
- **Cite as:** Greg Osuri, "Distributed training over the internet just became real," Interview With Greg Osuri, Founder Of Akash Network (Secret Network), 2 Apr 2025, 00:20:58. https://www.youtube.com/watch?v=k0HPDluOlsQ&t=1258s

## Quote — verbatim

> Google wrote a paper called DiLoCo last year, and a company called Prime Intellect implemented \[it\]... they were able to train a 10 billion parameter model over the internet... another company called Nous Research is going to do a 15 billion parameter model soon... there are five other companies doing decentralized training.

## Context — site annotation, not spoken

The "two months ago" breakthrough that unlocks his whole home-data-center thesis by removing the need for concentrated GPU clusters.