Models mature onto consumer gaming GPUs
RNDR, Supercloud, 1.5T AI Market Cap – Interview with Greg Osuri about Akash (Design DAO)
“Most advanced models like GPT-4, 3.5… work well on high-end GPUs, but as they mature, as they get older, they get optimized to work on a distributed set of GPUs like 3090s, 4090s and whatnot — the lower-end GPUs, like gaming machines. So people that prefer these mature models over advanced models can use the lower-end GPUs.” — 00:41:49
Context: Early articulation of his thesis that AI workloads migrate down to consumer hardware — frontier fine-tuning needs H100s (minutes vs hours), but mature models run distributed on gaming cards.