AIToday
Large Language ModelsAI Coding AssistantsTomasz Tunguz (Theory Ventures)Published: Sep 22, 2026, 01:00 JST

Jev, SemIf AI deciders cut if-then costs 99%

Jev, SemIf AI deciders cut if-then costs 99%

3 Key Points

  1. What happened

    Tom Tunguz describes a new wave of AI 'deciders' — Jev and SemIf — built for if-then questions like 'if plantain then produce', answering in hundreds of milliseconds at a 99% reduction in cost compared to traditional AI. They run the attention math once and then pick from allowed answers using just a few output tokens.

  2. Why it matters

    This suggests the biggest savings may come from specializing narrow programming primitives rather than using frontier models. Tunguz sees AI splitting into two economics: the largest models for discovery and system design, and optimized models for repeated production runs.

  3. What to watch

    The result hinges on whether this specialization generalizes beyond if-then logic; Tunguz asks which other primitives will benefit. If many primitives follow, he expects harnesses to capture a lot more margin.

WHO IT HITSThis lands on teams running AI in production workflows — engineers and product owners who pay per AI call at scale. If simple decision steps can be handled by cheaper specialized models, their running costs and accuracy on routine tasks may shift, though the gains shown come from one person's test.

Not sure about something? Ask the AI

Summaries like this, in your inbox every morning.

Context & Analysis

Tunguz builds his argument from an everyday analogy: grocery store rules like 'if banana, then produce' and their endless exceptions. Coding, he writes, means encoding those rules and exceptions into software, and AI has been used to handle the exceptions, such as identifying an unfamiliar fruit as Musa paradisiaca. But he argues the world's most brilliant model is not needed for if-plantain-then-produce logic.

The body then moves from that intuition to a concrete test. Tunguz went looking for if-then statements in his own code that he had handed to AI, and within a few minutes replaced about a quarter of those calls in one of his agents. Using Jev and SemIf, the specialized deciders nearly doubled classification accuracy on 98 hand-verified production email threads, jumping from 47% to over 80%.

He frames this as evidence that software primitives can be optimized one by one, with the if-then statement showing nearly two orders of magnitude in cost reduction alongside higher accuracy. That leads him to describe a bifurcating economics of AI: frontier models for discovery and architecture, narrower models for hardened production workflows. The open question he raises is which other primitives will follow, and whether harnesses are about to capture a lot more margin — a claim that hinges on whether this pattern repeats.

FAQ
What are Jev and SemIf?
They are a new wave of AI 'deciders' that answer if-then questions in hundreds of milliseconds. They simplify existing models by running the attention math once, then determining the probability of each allowed answer based on a few tokens of output.
How much cheaper are these deciders?
Tunguz reports a 99% reduction in cost compared to traditional AI for these if-then tasks. He also says they run in hundreds of milliseconds.
What did Tunguz find in his own code?
He replaced about a quarter of the AI calls in one of his agents within a few minutes. On 98 hand-verified production email threads, the specialized deciders nearly doubled the classification accuracy of the production model, jumping from 47% to over 80%.
Tomasz Tunguz (Theory Ventures)Read Original Article

Get the latest Large Language Models news every morning

For example, today's edition would include:

  • Meta Jumps 7.6% as Wells Fargo Lifts Target to $796 Before Meta ConnectYahoo Finance AI · 1h ago
  • Meta's Muse sparks tech rally; Arm surges 15%Yahoo Finance AI · 1h ago
  • Google's $899 Googlebook opens for pre-order, ships Oct 4TechCrunch AI · 1h ago

AI-summarized, only the topics you pick — one digest a day via Email, LINE, or Slack.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleUS floats superpower AI safety mechanism in China talks