Local Compute

“Heterogeneous GPUs over the internet means my phone or my MacBook with the M4 can be part of a training [run]. Even if I push it, even my PS5, I sit in idle, which I play once a year… I can even hack that to make it compatible with [DisTrO]. In fact, US Air Force hacked PS2s back in the day to create a supercomputer.” — Greg Osuri, 00:33:29

“There’s a relation on more distributed AI where your home computer is going to be powerful enough. They’re not going to be utilized all the time… And what happens when you have under utilization, they should be able to earn revenue, right?” — Greg Osuri, 00:50:34

“My new house I’m building [has] 60 kilowatt solar panel capacity, and 100 kilowatt battery… I’m building a little data center in the house that can house 32 H100s easily, and with a good enough internet — Starlink can provide pretty decent speeds — I can host a whole lot of inference, and I’m most certainly going to host my local AI.” — Greg Osuri, 00:20:38

“When AI becomes very important, if AI has to really enter the home — which I think it will — I think that’s when we’re going to see an explosion of these data centers… I think there’s going to be a resurgence of the data centers, for privacy, for ownership, for cost reasons.” — Greg Osuri, 00:25:27

“How do you make money? I give them Akash. Akash has 80% utilization rate right now — we can guarantee 80%… you can make your money back in four years, a $2 million investment back in four years, selling [compute] back to Akash… and you get to keep one of the servers for free. And we have financing available… 10,000 of these data centers can be the next Colossus.” — Greg Osuri, 00:23:54

“To power something like a 35 kilowatt data center we need about 4,000 square foot of roof space… a ranch house in Texas has 4,000 square foot roof space that can produce up to 80 kilowatts… say 100 kilowatts, that throughout the day gives you about 600 kilowatt[-hours] of energy… a battery pack to support 100 kilowatts for 12 hours… is going to cost $150,000.” — Greg Osuri, 00:23:11

“If we can spread training, that means we can have a lot of sub-50 kilowatt data centers — I call them home edge servers… HGX H200 clusters, very very fast. Each cluster can host a whole DeepSeek [R1], which is a big model by the way… the unit costs about $2 million. It’s not a home PC quite, but it has enough power to be able to be part of a larger training run.” — Greg Osuri, 00:21:40

“We’ll have an experimental supercluster maybe by end of the year… we have kind of one in a data center; now I’m putting [one] in a home… in a year we’ll be out with the supercluster, and we’ll probably deploy a bunch as experiments in the next year. I think year three will be at scale, at a global scale level.” — Greg Osuri, 00:32:59

“Instead of a few large hyperscale data centers, you want to be able to have small edge-optimized clusters that could be available in a residential or office setting that draws less than 50 kW capacity. That’s something that can be easily facilitated in a residential environment through solar… 10,000 of these clusters can actually build the biggest and the best state-of-the-art model.” — Greg Osuri, 00:16:16

“I don’t envision Akash going into hyperscale business… We see a future in edge data centers — 100 kW data centers to 1 MW data centers… that’s the sweet spot for decentralized technologies… there are models now that we put together where you can buy one of these edge data centers, place them on Akash, and get your ROI within like 3 years or 4 years.” — Greg Osuri, 00:25:36

“Our electric grid is so weak. Our utilities are so weak. And… the way we solve that is, [where] we have heavily centered around these, like, small areas, to decentralize them in a way that it cannot be attacked, right? Like, instead of having one large gigawatt data center, how about 1,000 megawatt data centers?” — Greg Osuri, 01:00:08

“One of the things that we’re doing right now is enabling these small module data centers… as long as you have real estate space that can install solar, I think you become a data center. The only way we’re going to be able to solve this problem is to harvest energy across the globe… if you have about 4,000 square feet of roof space, which most of Texas ranch homes do…” — Greg Osuri, 00:23:15

“The only way to achieve that is to have a GPU cluster running, and to run a DeepSeek you need a [DGX] cluster, about 8 GPUs. That way you have sovereign local AI… putting those boxes on Akash can earn income for you, because you’re hosting, you’re offering those boxes, and you can actually cover the cost in three years.” — Greg Osuri, 00:28:19

“The Akash home model is, you know, have about 40 GPUs, right, 40 H200s, which cost you about $2 million. Use eight H200s for your local AI… then rest 32, [lease] them out on Akash. You will recoup the investment in about two years. In fact, we can use DeFi rails to even fund the whole thing, so you don’t need to put up front.” — Greg Osuri, 00:29:46

“Phase one launches in 2025: data center grade star nodes… Phase 2 starts in 2026, telco edge… close to users, close to data, radically reducing latency and transport costs. Phase three, beginning in 2027: homes, schools, and local community sites. The long tail of underutilized infrastructure becomes active. A solar powered server in a rural school can train part of a global model. That’s the dream.” — Greg Osuri, 04:32:48

“Third, decentralized compute. This is the fastest lever of all. What if we didn’t have to wait for a new data center to be built? What if we tap into existing underutilized infrastructure in homes, universities, telco closets, and regional colos? This is where Akash thrives.” — Greg Osuri, 04:29:47

“Phase one is data center grade nodes coming online in 2025… Phase two is telco edge… closer to where data is generated. Phase three is homes, schools, and communities — the long tail, the untapped potential. Each phase expands scale, reach, and ownership… Akash isn’t [just] about decentralizing compute. It’s about decentralizing who gets to participate in AI’s upside.” — Greg Osuri, 00:08:56

“Three, decentralized compute. This is the lever no one saw coming. What if we didn’t have to wait for a $500 million hyperscale campus to come online? What if we could tap into underused servers, edge locations, telco closets, and even home rigs? With decentralized compute, we don’t need to centralize power. We distribute it.” — Greg Osuri, 00:06:03

“Decentralized compute — this is a game changer. Instead of building 10 massive data centers, what if we could tap into 10,000 smaller ones? Colos, edge nodes, university clusters, even your basement rig. And that’s what Akash does: ties them all together, monetizes their capacity, and routes workloads wherever they can run efficiently.” — Greg Osuri, 00:05:18

“Finally, the long tail: personal rigs, campus clusters, solar powered school servers. Every extra GPU becomes a part of a global AI mesh. Every participant earns by contributing compute. This isn’t charity — this is the new compute economy.” — Greg Osuri, 00:10:31

“Phase two starts in 2026: telco edge. Here we deploy into network dense environments — fiber huts, cell towers, base stations. Close to users, close to data, radically reducing latency and transport costs. Phase three, beginning in 2027: homes, schools, and local community sites. The long tail of underutilized infrastructure becomes active.” — Greg Osuri, 00:00:44

“Phase 2 starts in 2026, telco edge… fiber huts, cell towers, base stations, close to users, close to data… Phase three, beginning in 2027: homes, schools, and local community sites. The long tail of underutilized infrastructure becomes active. A solar-powered server in [a] rural school can train part of a global model. That’s the dream.” — Greg Osuri, 00:09:28

“Third, decentralized compute. This is the fastest lever of all. What if we didn’t have to wait for a new data center to be built? What if we tap into existing underutilized infrastructure in homes, universities, telco closets, and regional colos? This is where Akash thrives.” — Greg Osuri, 00:05:51

“Last year, Greg made the post on Akash at home. And I think there’s a really interesting intersection as we continue to grow of: can homeowners, can individuals, can business owners host their own compute, host their own power, share the excess capacity, and build much more resilient and faster scaling networks.” — Jason Badeaux, 00:12:09

“Smaller compute clusters can run near sources of localized renewable energy such as solar, wind, or geothermal energy, or take advantage of underutilized compute power sitting idle in homes, campuses, and communities.” — Greg Osuri, 00:02:55

“We do have the greatest fusion reactor sitting in our sky that we don’t capture… You can’t sell it back because no one’s going to buy your energy during the day… And batteries are still, the economics of batteries are still a little shaky… If you put a chip, like, I put a kilowatt chip, which 4090 is a kilowatt.” — Greg Osuri, 00:25:37

“If you can optimize your bandwidth and your energy costs, I think having a GPU data center at home is not a far-out reality. And we have the partners, we have distribution to get there… We think we’ll have it ready by next six months.” — Greg Osuri, 00:35:22

“By the end of the year, we’ll have a very high-quality model that competes with centralized models, right? So it’s not far out. Now, I’m putting my money where my mouth is and say, well, look, we are actually going to do it without any help from the state and the government. We don’t need to because economics, number one, play really well.” — Greg Osuri, 00:27:07

“It is cheaper, it’s better, it’s open. And if my child is going to grow up in a world relying on this technology, I want to make sure that she has complete sovereignty on what the technology is. And that’s the vision. That’s always been the vision.” — Greg Osuri, 00:39:59

“Our long-term vision has been the same since our white papers we wrote in 2018. It hasn’t changed at all. Our vision is sovereign compute. Compute is going to be like spice… Historically, spice was the most valuable commodity… Instead of giving up your sovereignty for comfort, we can have both.” — Greg Osuri, 00:36:05

“Of course, the goal is to go inside a house. That’s the vision of StarCluster. We are working with partners now, and I don’t want to disclose who they are to finalize the terms, but some of our partners are in about 22 million homes in America.” — Greg Osuri, 00:31:42

“We have access to 22 million homes right now through our partners in the US… Not just sell them, but actually deploy. I think the way we live may change, don’t you think?” — Greg Osuri, 01:01:56

“There’s lots of GPUs around… I have a 4090 here, a gaming machine. I have a Sony PlayStation that I barely use… there’s so many GPUs out there that were discarded by OpenAIs because they’re not the latest and the greatest… And the best part is if we can distribute GPUs, now we tap into energy when we’re available. It’s not like we don’t have enough energy. We just don’t have enough concentrated energy.” — Greg Osuri, 00:22:35

“We announced this program called Star Cluster program at Akash Accelerate… We’re partnering with a few telecoms… we have access to energy across America, we have access to about I think two million homes through our partners that we can go into potentially. We’re currently selecting ideal houses — solar and bandwidth are two big variables.” — Greg Osuri, 00:56:11

“You get free bandwidth, you get free energy… We’ll put solar in your home. We’ll put a battery in your home. You don’t have to pay a thing. We will charge our battery during the day, we’ll settle back to the grid when we make the most money, we’ll produce enough energy to power the GPU. So you get free energy, you get free bandwidth, maybe some money on top of it.” — Greg Osuri, 01:00:31

“Inference wasn’t very centralized. Inference is a lot more flexible when it comes to deployment. I would argue that it’s better when it’s at the edge. So getting access to edge resources with a common set of rules in a protocol is significantly better than having a centralized coordination layer.” — Greg Osuri, 00:16:13

“At home, it’s dual purpose, because I’m using solar to power my home, charge my car — and if I can use the same solar to power a data center, maybe a small home node or home data center, we have a dual purpose or multi-purpose solar, which is phenomenal. And your marginal cost of energy is zero at that point. That’s what I meant by solving this energy crisis by going into the home.” — Greg Osuri, 00:10:52

“5090s, right? So you can have six 5090s, 3,200 watts of capacity. I mean, we did the math — H100s are not economical at home in terms of ROI.” — Greg Osuri, 00:12:20