OpenAI's moat is GPUs and data, not the model — and it's eroding
DePin, Scams & Decentralized ML (Chris Joannou)
“What OpenAI has that other people don’t have is GPUs — that’s where the power comes in. It’s not the model, it’s really the GPUs and the data set. That’s where the power is… OpenAI was able to secure great deals with Nvidia, with cloud providers, to be able to get ahead in the game, but I don’t think they have the advantage anymore.” — 00:22:16
Context: After tracing GPT’s lineage to Google’s “Attention Is All You Need” paper, which he calls “the Bitcoin of AI.”