GPU demand doubling every 3.5 months; GPT-4 at a trillion parameters
Akash Network (AKT) Explained: Everything You Need To Know Before Investing by Founder Greg Osuri (Founder School)
“GPUs are the fuel for AI. The need for GPUs is doubling every 3.5 months as these LLM models get more advanced… GPT-3.5 is 175 billion parameters and GPT-4 is going to be a trillion parameters — that means you need that much of compute.” — 00:21:11
Context: Quantifying the AI compute curve just before GPT-4’s release; adds that OpenAI was proposing ~$250,000/year for a dedicated ChatGPT instance and “90% of the cost goes to GPU” (00:34:50).