Local Compute

“We came from data-center-only compute, because that’s the most reliable compute, now to home compute. That was part of our road map, because if we can make a home computer work in a cloud environment, that’s a holy grail — because now you can unlock the entire home… graduating from the perception of the cloud being data centers only to the perception of the cloud being the entire globe, or any connected device.” — Greg Osuri, 00:26:48

“Akash will have home nodes… After my testimony at Congress, I talked about leveraging home networks as part of a training run… we’re calling it the home node. I have home node one at my house that’s going to be online by the end of the month… Right now I have 60 panels that are part of a training run… hopefully in the next coming versions we’ll be able to reduce the energy footprint to a point I can have one single panel or two panels power a training run.” — Greg Osuri, 00:15:21

“I have about 12 GPUs now… six 5090s. They’re all running local LLMs… The big problem is energy, because I need a lot of energy. I have solar now at home.” — Greg Osuri, 03:16:33

“If training can go inside the house, it can tap into my solar, where my marginal cost of energy is like minimal, like almost zero… I have a lot of excess solar — using the excess solar to do some part of the training… in exchange I get back some token, some representation of the model, and when the model goes into inference and starts making money, I get some money out.” — Greg Osuri, 03:19:24

“So coming back to the original point of energy — I think people are going to have a lot of compute at home, because you can never trust [data leaving the house].” — Greg Osuri, 03:17:16

“Building Akash on a home computer based or a home network with the reliability, with the speed, with all the advantages that you would get with a data center is where the future is for us.” — Greg Osuri, 00:42:50

“Robots themselves will not have — they’ll have enough intelligence for motor functions and whatnot, but they don’t have a lot of intelligence. In order for them to maintain intelligent, they need to connect to a GPU network or a computer network. And it has to be low latency.” — Greg Osuri, 00:14:21

“Star Cluster’s the vision is to have sovereign AIs. And when you’re not using your AI, you can share the compute and thereby compute to do training or whatever other tasks you want to do. So a lot I think in 6 months time you’re going to have a very different future to what we have right now.” — Greg Osuri, 00:15:02

“That’s why when I said farmland — I think that’s the ultimate safety bet you can actually make. If you have food to eat and shelter and water — and farmland will give you ample opportunity to capture solar, and even have data centers or small buildouts, with Akash home node coming along very soon. I’m very pro rural and less urban.” — Greg Osuri, 02:13:08

“The shortage is going to get worse. And what happens when you have shortage? You borrow from peers, you borrow from your neighbors. What Akash enables is borrowing compute power from your neighbors that are not in physically geographical accessible distance for you — basically making anyone your neighbor that you can borrow from.” — Greg Osuri, 00:31:22

“You look at a lot of things I’ve been calling out about electric vehicles being data centers on wheels. I tweeted this about I don’t know 5 years ago and you see Elon Musk talking about [Teslas] becoming a potential data centers on wheels because they do have GPUs.” — Greg Osuri, 00:28:25

“Now with the energy crisis, data center GPUs are no longer the only source we can tap into, because the data center space now is so hard to get in America or in the West… distributed training and distributed inference are getting good… to a point [that] actually we can consider home computers, 5090s and 4090s, as a potential source of GPUs — considering we solve the reliability problem.” — Greg Osuri, 00:22:32

“I’m a lot more convinced that as the models get more optimal in terms of training, you have higher chances of succeeding from a home-based computer than a data center based computer.” — Greg Osuri, 00:39:17

“We announced home node… this program to attract more computer nodes that are in the home, that are 4090s and 5090s. So we’re going to see a big [rollout], and we have an enterprise partner we’re rolling out with… we have a huge rollout plan for home computers… When that happens we want to be the first, we want to be the platform to take advantage of distributed training.” — Greg Osuri, 00:23:56

“You can actually have a 5090, which is a very powerful GPU, [in] your home. Put the Akash home node, and if you lease it out, you can amortize your entire investment within 8 months.” — Greg Osuri, 00:41:21

“My home itself has solar capable of hosting good eight H100 nodes. I can tap into my solar… and I can use that heat that’s coming from my compute to power my home. So you have this incredible harmony between compute, data centers, and my life.” — Greg Osuri, 00:34:57

“In a recent tweet I said only mo[a]t you really have is owning computer and a way to distribute it… You got to own your source of intelligence.” — Greg Osuri, 00:16:30

“I can see a future where a state-sponsored loan for your computer is not something out of fiction. I think it can be a reality where the government can sponsor your computer… your contribution is your roof space.” — Greg Osuri, 00:42:04

“Instead of bringing power to where the computer is, how about you take compute to where the power is? That’s the area of research that’s very exciting in AI right now… that’s called distributed training.” — Greg Osuri, 00:32:50

“Initially, Akash was mostly data center compute, but now we’re going into homes with usable compute as well. Homes being one of the best resources, one of the least understood resources… Homes are extremely efficient when it comes to energy usage. Latency is a symptom, not a cause… It’s not a critical component for training as well as inference.” — Greg Osuri, 00:38:12