# Distributed training is in its GPT-3 era, limited only by compute

- **Speaker:** Greg Osuri
- **Attribution:** attributed
- **Said:** 2025-06-03
- **Theme:** Decentralized AI — https://www.gregosuri.com/predictions/decentralized-ai/
- **Source:** Scaling Web3 and AI through DePIN with Greg Osuri! (Secret Network)
- **Watch at:** 00:18:09 — https://www.youtube.com/watch?v=TWw18D8zUto&t=1089s
- **Canonical:** https://www.gregosuri.com/predictions/decentralized-ai/2025-06-03-distributed-training-is-in-its-gpt-3-era-limited-o-soyr/
- **Cite as:** Greg Osuri, "Distributed training is in its GPT-3 era, limited only by compute," Scaling Web3 and AI through DePIN with Greg Osuri! (Secret Network), 3 Jun 2025, 00:18:09. https://www.youtube.com/watch?v=TWw18D8zUto&t=1089s

## Quote — verbatim

> We're still in the GPT-3 era of decentralized distributed training, but it's progressing very fast, and only limiting factor is the amount of compute you can throw at it... how do we get the compute is through incentivization. So if you can create a viable incentive model, that's where crypto plays a big major role — if you contribute compute, you somehow have rights in the future earnings of that model.

## Context — site annotation, not spoken

Comparing Prime Intellect's 16B/32B distributed models to GPT-4.5-era centralized frontier models; crypto incentives are the mechanism to close the gap.