Memory is hot property amid AI boom, as Micron sells out of HBM through 2025

For LLMs “GPU RAM is actually one of our most valuable commodities. It's frequently the bottleneck, not compute…”

Edward Targett

Mar 24, 2024 - 3 min read

Compute and memory side-by-side: Key twin pillars of LLM performance.

High-bandwidth memory (HBM) supplies from Micron are largely sold out all the way out until 2025 amid a boom in demand driven by the AI frenzy, with one customer alone paying $600 million up-front to lock in supply.

Get the full story: Subscribe for free

Join peers managing over $100 billion in annual IT spend and subscribe to unlock full access to The Stack’s analysis and events.

Subscribe now

Already a member? Sign in

Success! You now have access to additional content.