# Distributed training hits GPT-3 level by end of year

- **Speaker:** Greg Osuri
- **Attribution:** attributed
- **Said:** 2025-07-31
- **Theme:** Decentralized AI — https://www.gregosuri.com/predictions/decentralized-ai/
- **Source:** Solving AI's Energy Crisis with Decentralized Compute, w/ Akash CEO Greg Osuri (The People's AI: The Decentralized AI Podcast)
- **Watch at:** 00:19:37 — https://podcasts.apple.com/us/podcast/solving-ais-energy-crisis-with-decentralized-compute-w/id1792518750?i=1000720143134
- **Canonical:** https://www.gregosuri.com/predictions/decentralized-ai/2025-07-31-distributed-training-hits-gpt-3-level-by-end-of-ye-p7mv/
- **Cite as:** Greg Osuri, "Distributed training hits GPT-3 level by end of year," Solving AI's Energy Crisis with Decentralized Compute, w/ Akash CEO Greg Osuri (The People's AI: The Decentralized AI Podcast), 31 Jul 2025, 00:19:37. https://podcasts.apple.com/us/podcast/solving-ais-energy-crisis-with-decentralized-compute-w/id1792518750?i=1000720143134

## Quote — verbatim

> The biggest model is 72 billion parameter model. For comparison, GPT-3 was 150 billion parameter model. So we're very, very close to GPT-3... So if you were to ask me where distributed training is, it's about pre-ChatGPT-3. And by end of the year, it will be ChatGPT-3 level.

## Context — site annotation, not spoken

Dated benchmark prediction (end of 2025). Cites the sponsor protocol (likely Gensyn; Whisper: "Jensen") running ~12,000 models training concurrently, plus zero-knowledge gradient verification enabling permissionless nodes [00:18:11].