
OpenAI introduced a new way to measure AI value on July 17, 2026.
It focuses on useful outcomes per dollar, not token prices.
Companies should calculate the full cost of completing a task, including human review and retries.
What happened
OpenAI released a new evaluation framework on July 17, 2026, urging companies to measure AI ROI by 'useful outcomes per dollar' rather than traditional IT metrics. The framework includes four questions covering work volume, total task cost, reliability, and value over time.
Why it matters
The framework challenges the conventional focus on token prices, arguing that a cheaper model requiring multiple retries can cost more than a pricier one that finishes correctly the first time. OpenAI suggests comparing total task cost, including compute, human review, and rework time, not just per-token price.
What to watch
OpenAI recommends a hybrid approach—using lightweight models for routine work and top-tier models for complex reasoning—to optimize cost per completed task. The company says it is tracking results using three patterns: usable as-is, needs editing, and needs escalation.
Ask the AI about this article →
OpenAI's announcement on July 17, 2026 aims to shift how businesses evaluate AI investments. The new framework moves beyond the industry's common focus on token pricing, pushing companies to consider the full economic picture of a task. By defining "output" in business terms—like customer support ticket resolutions or code changes merged—the company wants organizations to measure the actual productive output AI enables, not just the cost per token.
The framework also highlights a practical insight: a cheaper model that requires multiple retries and human review can end up costing more than a more expensive model that gets the answer right the first time. This suggests that the total cost of a completed task—including compute, labor, and rework—should guide model selection. OpenAI's proposed hybrid approach, using lightweight models for routine work and top-tier models for complex reasoning, could help companies balance cost and performance.
The emphasis on reliability and trust is notable. OpenAI outlines a three-level pattern for evaluating trust: output usable as-is, output needing editing, and output requiring escalation. This acknowledges that AI adoption is gradual, and human oversight remains necessary. As companies scale AI use, tracking metrics like task volume, cost, and value over time could become standard practice, potentially changing how AI ROI is assessed across industries.
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
Samsung Electronics has locked up as much as 70% of its memory production capacity under long-term supply agre…

Recent controversies include Ajinomoto's official X account posting an AI-edited image and a restaurant menu s…

Meta announced on August 31 (local time) that it is changing the name of the 'AI creator' label it has been te…

A UK study by UK AI Security Institute and Limbic AI surveyed 6,474 British adults

CrowdStrike shares rose 5.77% on Monday, driven by investor excitement over its AI-powered cybersecurity growt…

Nvidia paused some deals under its AI financing program, which offered credit support to smaller AI cloud comp…
