
What happened
SanDisk and SK hynix released the first Open Compute Project (OCP) technical specification for HBF (High Bandwidth Flash) on August 3, 2026, six months after the consortium began work in February. Google and Tenstorrent joined as consortium members and contributed to technology validation and standard development.
Why it matters
AI inference systems require high-bandwidth memory positioned close to compute cores, and HBF technology addresses this by combining high capacity with high bandwidth to improve power efficiency and reduce total cost of ownership. The specification gives system designers a common technical framework and practical path to build flexible architectures where HBF can coexist with existing high-bandwidth memory.
What to watch
The specification defines system interface, electrical guidelines, the xPU-HBF host interface, reliability and packaging guidance for HBF die stacks, and a software user guide for read and write operations—establishing the first technical standard of its kind in the memory and storage industry.
Summaries like this, in your inbox every morning.
The standardization of High Bandwidth Flash represents a coordinated industry response to a specific technical challenge: AI inference systems increasingly need memory that is both fast and large, positioned physically close to processing cores. The body notes that this demand stems from the requirements of large language models and emerging AI workloads, which the specification framers saw as a defining characteristic of the inference era. By completing the specification six months after launching the effort in February 2026, the consortium demonstrated focused execution, and the participation of Google and Tenstorrent alongside the primary contributors SanDisk and SK hynix suggests broad validation across both memory manufacturers and compute-system designers.
The specification's scope—covering system interface, electrical standards, host interface design, packaging, and software guidance—is comprehensive enough to allow system designers to build HBF into their architectures with reduced risk and design cycle time. Notably, the body emphasizes that the standard enables HBF to coexist with existing high-bandwidth memory technologies rather than displacing them, offering designers architectural flexibility. According to SanDisk's CTO, this flexibility helps "improve token economics at scale," framing the technical advance as directly relevant to the operational efficiency of large language model deployment.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.