# Distributed training will be a thing; big labs' moat in doubt

- **Speaker:** Greg Osuri
- **Attribution:** attributed
- **Said:** 2026-02-24
- **Theme:** Decentralized AI — https://www.gregosuri.com/predictions/decentralized-ai/
- **Source:** LIVE from NEARCON Day 1 In SF (The Rollup)
- **Watch at:** 03:20:06 — https://www.youtube.com/watch?v=oQ93LgM1N-o&t=12006s
- **Canonical:** https://www.gregosuri.com/predictions/decentralized-ai/2026-02-24-distributed-training-will-be-a-thing-big-labs-moat-cqpu/
- **Cite as:** Greg Osuri, "Distributed training will be a thing; big labs' moat in doubt," LIVE from NEARCON Day 1 In SF (The Rollup), 24 Feb 2026, 03:20:06. https://www.youtube.com/watch?v=oQ93LgM1N-o&t=12006s

## Quote — verbatim

> I think distributed training will be a thing. And of course we're not going to replace the major labs doing their own thing, but with distillation, all these techniques these days, I don't know what kind of mo\[a\]t the major big labs are going to continue having.

## Context — site annotation, not spoken

Models getting smaller and smarter make distributed training viable; cites Peter Steinberger's viral agent product as proof that individuals without funding can now build history-making products.