LLM costs are limiting adoption — new product cuts time and cost
What is Akash Network? Greg Osuri on Decentralized Cloud Computing | Greg Osuri - Founder of Akash (Genzio)
“The challenge today is for LLM developers to deploy an LLM and use an LLM that is large, like a Llama 3.1 405B, takes about 6 hours. It’s extremely expensive… it costs about $30 per hour… so we have a new product that’s going to significantly reduce the cost and the time it takes to run LLMs, so that way you’ll be able to attract your traditional web2 developers, and Akash will be one of the most attractive products not only in web3 but also web2.” — 00:16:39
Context: Teasing an end-of-2024 launch, preceded by login-free credit card payments “next week.”