Open source AI is two to three months from catching closed AI
AI Made in Cosmos - with Greg Osuri, Murthy Vitwit, Valery Litvin & Dean Tribble (Cosmoverse)
“The open source AI is maybe two to three months away from catching up to closed source AI. It’s very good — in some cases, like Llama 3.1, which is a 405 billion parameter model, exceeds the quality of closed source AI.” — 00:08:00
Context: Asked about the state of open source AI; he caveats that Llama came from closed Meta ($100M, ~30,000 H100s) and whether the next model is open-sourced “is still unanswered.”