Memory chips could be the next bottleneck for AI
2 weeks ago

Memory chips could be the next bottleneck for AI

Live Mint  

Investors are accustomed to volatility in the semiconductor industry. On October 24th SK Hynix, which has surged ahead in the fast-growing segment of high-bandwidth memory chips, which are needed for AI, reported a record profit. More than nine-tenths of the time it takes an AI model to respond to a user query is spent shuttling data back and forth between logic and memory chips, according to SK Hynix. View Full Image The chips are also highly profitable, with operating margins more than five times those of standard memory chips.SK Hynix, whose share price has more than doubled over the past two years, controls over 60% of the market, and more than 90% for HBM3, the most advanced version. Meanwhile Samsung, which manufactures 35% of the world’s HBM chips, has been plagued by production issues and reportedly plans to cut its output of the chips next year by a tenth.

History of this topic

Nvidia CEO Jensen Huang confident Samsung will overcome HBM production challenges, produce AI memory chips
1 day, 5 hours ago
US to Introduce New Restrictions on China’s Access to Cutting-Edge Chips
55 years ago

Discover Related