Market shift from single GPUs to 50-100 node H100 clusters on long-term contracts
The Infrastructure Behind Agentic Finance, with Shashank Yadav and Greg Osuri of Akash Network (Fraction AI)
“The winds have shifted from people individually getting individual GPUs to taking large quantities of GPUs… we’re in the process of refactoring our marketplace to support large orders… 50 to 100 nodes, each node having eight H100-type nodes… people are leaning towards long-term contracts versus on-demand… ‘I’m going to pay $2 for H100, I want this price to be locked in for the next two years.’” — 00:16:40
Context: Asked how many GPUs Akash has: pipeline of 10-15K GPUs waiting to come online, 15-20K expected after the redesign; on-demand demand has shifted mostly to inference hosting.