
Marvell Technology released a portfolio of memory infrastructure products designed to address AI bottlenecks by disaggregating memory from compute and pooling it across servers and racks.
The three-product suite—including an SSD controller, CXL memory expansion devices, and optical fabric for cross-rack memory sharing—aims to help cloud providers reuse existing capacity, reduce stranded resources, and improve token throughput for inference workloads with large memory footprints.
What happened
Marvell Technology announced three product families—Bravera SC6 SSD controller, Structera CXL memory family, and Photonic Fabric optical components—designed to separate memory from compute and move data processing closer to where it is needed in AI workloads.
Why it matters
Cloud providers face memory constraints as AI models grow larger and more demanding. Marvell's portfolio lets hyperscalers reuse existing memory capacity (like DDR4 from decommissioned machines), pool memory across racks, and extend memory up to 50 meters away using optical links—reducing wasted infrastructure and improving efficiency for inference tasks that require large context windows and key-value cache.
What to watch
The Structera X compression feature claims to deliver roughly 2 to 2.5× the effective memory capacity compared with standard approaches; Photonic Fabric claims two to three times the token throughput within existing data center footprints and power envelopes, though actual gains depend on workload characteristics and system implementation.
Ask the AI about this article →
Marvell's announcement reflects a broader industry shift in how hyperscalers approach AI infrastructure. Rather than building systems around fixed, server-local memory, cloud providers increasingly need the flexibility to pool and move memory dynamically as AI models become larger and their memory demands grow unpredictably. The portfolio targets three distinct levels of the infrastructure stack: server-level storage (via Bravera SC6), rack-scale memory expansion (via Structera), and cross-rack distributed memory (via Photonic Fabric). This tiered approach recognizes that different workloads—from inference with large context windows to recommendation engines and vector search—have different memory requirements and latency tolerances.
The emphasis on reusing existing DDR4 capacity, highlighted by Meta's adoption of CXL-based memory expansion across millions of servers, reveals a practical concern: capital efficiency. Hyperscalers want to extend the life of hardware they have already purchased rather than retire it. Marvell positions itself as a portfolio player able to bridge multiple memory technologies and scales, from NAND storage controllers that give customers fine-grained control over flash behavior, to CXL switches that convert between protocols, to optical fabrics that extend memory across physical distances. The claimed performance gains—2 to 2.5× memory capacity from compression, two to three times token throughput from Photonic Fabric—remain contingent on workload and implementation, a qualification that reflects the complexity of real-world deployment.
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
Aranya Inc., a startup founded last year, launched today with $11 million in funding
CBTS Technology Solutions LLC launched Forge Agents, a platform that turns a plain-language job description in…
Phonely Ltd. launched Alma, a large language AI model built for voice agents and trained on over 10 million re…
Imec CEO Patrick Vandenameele said at SEMICON Taiwan 2026 that the Belgian research center is broadening its c…

Alphabet's AI Overviews now reach over 2.5 billion monthly users through Google Search, and its ad business ge…

Sarah O’Connor's book 'We Are Not Machines' explores how mechanization and AI have transformed the workforce…
