Meta’s Next Llama AI Models Are Training on a GPU Cluster ‘Bigger Than Anything’ Else
Meta CEO Mark Zuckerberg laid down the newest marker in generative AI training on Wednesday, saying that the next major release of the company’s Llama model is being trained on a cluster of GPUs that’s “bigger than anything” else that’s been reported. “We're training the Llama 4 models on a cluster that is bigger than 100,000 H100s, or bigger than anything that I've seen reported for what others are doing,” Zuckerberg said, referring to the Nvidia chips popular for training AI systems. On Wednesday, Zuckerberg declined to offer details on Llama 4’s potential advanced capabilities but vaguely referred to “new modalities,” “stronger reasoning,” and “much faster.” Meta’s approach to AI is proving a wild card in the corporate race for dominance. Although touted as “open source” by Meta, the Llama license does impose some restrictions on the model’s commercial use.
Discover Related
'Patriotic Chest Thumping Not Real Innovation': AI Founder Calls Out Bhavish Aggarwal’s Krutrim Over Llama 4 Hype
IIT Madras partners with Ziroh Labs to establish Centre of AI Research
Evaluation of AI large language models in final stage: Ashwini Vaishnaw
Forget ChatGPT? China’s DeepSeek is working on smarter, self-improving AI models
The AI Race Has Gotten Crowded—and China Is Closing In on the US
New AI benchmarks test speed of running AI applications
New AI benchmarks test speed of running AI applications
OpenAI raises $40 billion, valued at $300 billion in historic funding round
Sam Altman Says OpenAI Will Release an ‘Open Weight’ AI Model This Summer
Good response to India AI Mission: MietY
China floods the world with new low-cost AI models after DeepSeek’s success, undercutting OpenAI, Google, and others
DeepSeek rolls out V3 AI model updates in race against OpenAI. What's New?
Beijing AI academy slams inclusion on US Entity List
Jack Ma-backed Ant Group touts AI breakthrough using Chinese chips
Tencent upgrades AI model to compete with DeepSeek, Alibaba
Tencent launches T1 reasoning model amid growing AI competition in China
Nvidia CEO Jensen Huang unveils new Rubin AI chips at GTC 2025
Nvidia looks to further its AI stronghold with new chips and personal supercomputers
Nvidia CEO Jensen Huang unveils new Rubin AI chips at GTC 2025
Nvidia unveils Blackwell Ultra and Vera Rubin, its latest AI superchips
Nvidia CEO Jensen Huang unveils new Rubin AI chips at GTC 2025
Nvidia's Jensen Huang to unveil cutting-edge AI and quantum computing processors
China's Baidu launches two new AI models as industry competition heats up
Nvidia’s next act needs to be even bigger
Mint Primer: AI power shift: Can China close the gap with the US?