← GPU Economics

ChatGPT needs one H100 per concurrent user

How Akash Network is Democratizing Access to Cloud GPUs | Greg Osuri (0xResearch)

“Every time you hit a prompt in ChatGPT, the time it takes to come back requires one H100 per each concurrent user for that time. Now do the math: 100 million users… that’s talking about 100 million H100s. That’s impossible — they don’t exist.” — 00:16:43

Context: Explaining why inference scales with users and why OpenAI throttles concurrency; frames the structural GPU shortage.

See it among all GPU Economics predictions →