The future of inference is the home
This Crypto Turns GPUs Into Income For Everyone!!!! (AllinCrypto)
“So, if you ask me the future of inference is going to be home? It’s going to be local… and it’s dual purpose. You can actually use that to heat your home and you’re using excess capacity anyway.” — 00:37:50
Context: After arguing privacy (“no way in hell” home sensor data leaves his house) and citing California’s ~60 GW of underused rooftop solar; TEEs let idle home GPUs serve others’ inference privately.