
What happened
In the test, Haiku 5.5 on medium setting averaged scores close to Sonnet 5.5 on routine documents at about 1/17th the cost, but dropped to 6.3 points on the English email task.
Why it matters
The test backs Anthropic's claim that Haiku 5.5 suits cost- and speed-focused, narrow tasks, but for complex document work a Sonnet-tier model looks more suitable.
Summaries like this, in your inbox every morning.
Anthropic released Claude Haiku 5.5 on October 7, positioning it as its lightest model suited to cost- and speed-focused tasks. The company itself limits its recommended uses to summaries, context compression, and sub-agents, saying Sonnet 5.5 or Claude Opus 5.5 remain better for complex agentic coding.
The test pitted Haiku 5.5 against Claude Sonnet 5.5 and GPT-6 Luna across three tasks: an apology email for a late delivery, meeting minutes from handwritten notes, and summarizing and replying to an English email from an overseas client. Scoring was done by Claude Fable 5.1 and GPT-6 Astra, averaged and rounded. Results showed Haiku 5.5 performed well on routine documents but struggled when it needed to grasp its own position.
Artificial Analysis's Intelligence Index placed Haiku 5.5 (max) at 43 points, up 26 points from Claude Haiku 4.5 and above GPT-6 Luna (38), but noted it outputs about three times as many tokens per task as GPT-6 Luna's max. Anthropic's API pricing shows Haiku 5.5 at $0.10 input and $0.50 output per 1 million tokens for prompts under 100,000 tokens — matching GPT-6 Luna and 20 times cheaper than Sonnet 5.5.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
Circlia started a proof-of-concept for TASTE SIGNAL: visitors to Holland Village Cafe FUKUOKA taste cookies an…

In a webinar hosted by French Mathematical Society president Isabelle Gallagher, Fields Medal winner Hugo Dumi…

NVIDIA released Nemotron 3.5 Bolt 74B-A9B 24GB, an AI model for local agents that hits over 80 tokens per seco…

NVIDIA released Nemotron 3.5 Super VL, an open-weight model with 120 billion parameters that handles text, ima…

NVIDIA published a blog post titled "AI Security Is an Engineering Problem - How to Solve It at Every Layer of…

PrismML released Ternary Bonsai 2 2B, 4B and 9B on October 15, 2026, remade from Qwen3.5 to process in three v…
