AIToday
Large Language ModelsAI Business & IndustryOpenAI BlogPublished: Aug 26, 2026, 01:01 JST

OpenAI first custom AI chip shows measured gains

OpenAI first custom AI chip shows measured gains

3 Key Points

  1. What happened

    OpenAI shared the first measured performance results from Jalapeño, its first custom inference chip, on a public benchmark using GPT‑OSS 120B. The chip delivered more peak throughput per kilowatt and lower token latency than the commercial systems in the comparison, and also performed strongly on DeepSeek R1 and Kimi K2.

  2. Why it matters

    The chip gives OpenAI greater control over how its models run and over the economics of serving them. By developing chip, software, and models together, OpenAI can improve throughput, latency, energy efficiency, and cost as one system, creating a credible first-party path alongside accelerators from partners like Microsoft and NVIDIA.

  3. What to watch

    Whether the chip's gains extend beyond the benchmark into production economics. The claims hinge on measured results, and OpenAI says future generations are already underway, so watch for how quickly it scales beyond initial deployment.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

OpenAI's announcement is part of a broader compute strategy described as one integrated system, spanning chips, data centers, models, and products. The company says better technology creates better economics, which funds further research. Jalapeño is a step toward controlling more of that stack, reducing reliance on external chips for inference workloads. The measured results on public benchmarks are early but tangible progress.

The company frames efficiency gains in economic terms, citing Jevons paradox, where greater efficiency expands consumption. For business readers, the practical effect is what matters: if custom chips lower serving costs, those savings could translate into more affordable AI products. OpenAI also highlights that better models use fewer output tokens to reach answers, cutting costs further for developers.

The longer-term question is whether this chip can scale beyond benchmark promise to production performance, and whether it will deliver meaningfully lower costs for customers. OpenAI says future generations are underway, but the near-term impact on pricing likely remains several quarters away.

FAQ
What is an inference chip?
An inference chip is a processor designed to run AI models after training, helping the AI produce answers efficiently. Jalapeño is OpenAI's first custom chip built for this purpose.
How does the chip compare with existing systems?
On a public benchmark, Jalapeño delivered more peak throughput per kilowatt and lower token latency than the commercial systems it was compared against. It also performed strongly on DeepSeek R1 and Kimi K2 models.
Why did OpenAI build its own chip?
Developing the model, software, chip, and network together lets OpenAI improve performance and cost as one system. It creates a first-party option alongside chips from partners like NVIDIA.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleRopedia launches HOMIE Gen2 wearable for robot training