Home gaming PCs will train models — "yes, one day, not yet"
How Akash Network is Democratizing Access to Cloud GPUs | Greg Osuri (0xResearch)
“Can your home gaming PC be used for training? Yes, one day — not yet… We’re seeing gaming PCs actually getting a lot more used, and the rate at which they’re getting used is on uptrend. So that indicates that yes, in a not very distant future these gaming PCs will be a lot more usable.” — 00:18:07
Context: Notes Llama/Llama 2 already run “fairly decently on a 4090” and RTX Ada 6000 gaming cards are increasingly used for ML over A100s/H100s (cheaper, more on-chip memory); second half of quote at 00:19:32. Cites an NYU-based team building heterogeneous training (mixing 4090s and H100s) on Akash (00:18:07).