# First foundation model trained on a decentralized network

- **Speaker:** Greg Osuri
- **Attribution:** attributed
- **Said:** 2024-05-20
- **Theme:** Decentralized AI — https://www.gregosuri.com/predictions/decentralized-ai/
- **Source:** Hash Rate - Ep 050 - Akash Decentralized Cloud - Greg Osury (Hash Rate Podcast)
- **Watch at:** 00:16:30 — https://www.youtube.com/watch?v=S6niawECR8A&t=990s
- **Canonical:** https://www.gregosuri.com/predictions/decentralized-ai/2024-05-20-first-foundation-model-trained-on-a-decentralized-fk56/
- **Cite as:** Greg Osuri, "First foundation model trained on a decentralized network," Hash Rate - Ep 050 - Akash Decentralized Cloud - Greg Osury (Hash Rate Podcast), 20 May 2024, 00:16:30. https://www.youtube.com/watch?v=S6niawECR8A&t=990s

## Quote — verbatim

> Thumper is another startup that did a full foundational model training from scratch on Akash using 24,000 A100 hours, which is a first example, I think, a decentralized network is used to train a foundation model. It took about two months to train.

## Context — site annotation, not spoken

Listing AI users; also claims Nous Research is "one of the biggest users of Akash" and believed to be training their next model on it.