
What happened
Each new generation of Nvidia's AI accelerators requires substantially more memory than the previous one. The H100 contained roughly 80 gigabytes of high-bandwidth memory (HBM), the H200 increased that to approximately 141 gigabytes, and the latest Blackwell chips reached roughly 192 gigabytes. This pattern of rising memory demands per chip creates a second growth driver for Micron beyond simple GPU sales volume.
Why it matters
As AI models grow larger and more sophisticated, they need access to more information simultaneously—particularly reasoning models that perform more computational steps before producing an answer, and applications that process text, images, audio, and video at once. Memory now plays a larger role in overall AI performance than it did a few years ago. This means Micron could generate meaningful growth even if AI server growth eventually moderates, because each chip would require more memory content than before.
What to watch
The critical question is whether HBM—the memory specially designed for AI data centers—remains difficult to manufacture and increasingly critical to AI performance. If HBM stays scarce and essential, Micron could deliver stronger returns. If HBM becomes a commodity product, the industry may repeat its historical memory-price-decline cycles.
Ask the AI about this article →
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
CrowdStrike Holdings Inc
ASE Technology CEO and SEMI Global Board Executive Committee Chair Tien Wu said AI's early-stage growth is cre…

Fervo Energy signed a deal to supply 396 MW of electricity from its Cape Station project in Utah to a Google d…

Nvidia co-announced with Vertiv in August that it is making progress on 800-volt power infrastructure for its…

John Ternus takes over as CEO of Apple today, stepping into the role as the company confronts the AI era

Top AI-native open source projects like Flue and tldraw are refusing external pull requests, often because the…
