GPU demand doubling every 3.5 months; GPT-4 at a trillion parameters
Akash Network Live with Greg Osuri: Akash's progress in 2023, open community development, and more (Akash Network)
“GPUs are the fuel for AI… the need for GPUs is doubling every 3.5 months as these LLM models get more advanced… GPT-3.5 is 175 billion parameters and GPT-4 is going to be a trillion parameters — that means you need that much of compute.” — 00:21:35
Context: Adds that OpenAI was proposing ~$250,000/year for a dedicated ChatGPT instance (00:22:17) and that ~90% of LLM cost goes to GPUs (00:35:11), positioning Akash as the low-cost GPU vendor for the AI wave.