AIToday
Large Language ModelsAI Coding AssistantsTHE DECODERPublished: Nov 3, 2026, 22:01 JST

Anthropic's Message Threads cuts time to first token by 35%

Send on LINE
Anthropic's Message Threads cuts time to first token by 35%

3 Key Points

  1. What happened

    Anthropic released Message Threads as a public beta on its Claude platform, which cuts time to first token by about 35 percent for requests between 500,000 and one million tokens by sending only what has changed.

  2. Why it matters

    Coding agents, computer-use agents, and workflows processing lots of documents or images benefit the most, according to Anthropic, though token usage doesn't change since Claude still reads the full conversation history.

WHO IT HITSDevelopers building long-running AI agents on Claude—especially those handling coding, computer use, or large document and image workflows—could see faster responses on very long conversations, though token costs stay the same.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

Until now, every API request to Claude had to resend the entire conversation history, which meant long exchanges carried a growing payload with each turn. Message Threads changes that by transmitting only what's changed since the last message, and Anthropic says the result is about a 35 percent cut in time to first token for requests between 500,000 and one million tokens. That speedup is aimed at the heaviest users: coding agents, computer-use agents, and workflows processing lots of documents or images, the company says. Notably, the change does not lower token usage, since Claude still reads the full conversation history—so the benefit is latency, not cost. The feature is a public beta on the Claude platform and works through AWS, Microsoft Foundry, and Google Cloud, with threads kept encrypted in memory and expiring after five minutes of inactivity.

FAQ
Does Message Threads reduce token usage?
No. Token usage doesn't change because Claude still reads the full conversation history.
How long does a thread stay alive?
The thread stays encrypted in memory between requests and expires after five minutes of inactivity.
Where can developers use Message Threads?
It works on the Claude platform and through AWS, Microsoft Foundry, and Google Cloud.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleQLoRA beats full fine-tuning as default for style tuning, 7B test finds