AIToday
Large Language ModelsAI Business & IndustryAmazon AI BlogPublished: Sep 16, 2026, 04:00 JST

Amazon Bedrock prompt caching cuts costs up to 90%

Amazon Bedrock prompt caching cuts costs up to 90%

3 Key Points

  1. What happened

    Amazon said prompt caching in Amazon Bedrock can reduce cached input token costs by up to 90 percent, letting a 10,000-token document be reused across many questions.

  2. Why it matters

    Instead of paying full price for a document every time, `cacheReadInputTokens` is billed at 90 percent below standard input, while the first write (cacheWriteInputTokens) costs 25 percent more than standard input.

  3. What to watch

    The savings depend on whether later requests arrive inside the time-to-live window, since the default is 5 minutes and expired requests trigger a new cache write at the higher rate.

WHO IT HITSThis lands hardest on developers and technical teams building Amazon Bedrock applications that repeatedly send the same long documents, system prompts, tool definitions, or tenant-specific context. Their core trade-off shifts from trimming prompts or context windows to managing cache lifetime and token thresholds.

Ask the AI about this article →

Summaries like this, in your inbox every morning.

Context & Analysis

Amazon's post frames prompt caching as an infrastructure-level fix for a familiar cost problem. Without caching, a 10,000-token contract sent alongside 50 user questions means 500,000 input tokens billed at full price, even though much of that content has already been processed. The article lays out three workarounds and their trade-offs: shortened prompts may reduce context quality, smaller context windows weaken reasoning over complete information, and response caching does nothing when the same context is paired with different questions. Prompt caching is presented as a fourth path that avoids those compromises.

The mechanics matter because they are where the savings come from. A cachePoint marker tells Amazon Bedrock to compare the preceding content against existing cache entries, scoped to individual AWS accounts and Regions. A cache hit skips reprocessing and starts generation from the cached state; a cache miss processes everything and writes a new entry. Amazon also lists two new token categories, cacheWriteInputTokens and cacheReadInputTokens, priced at 25 percent higher and 90 percent lower than standard input respectively. The 90 percent reduction applies to cache reads, and the approximately 75 percent net savings for a repeated document assumes later requests land inside the time-to-live window.

The practical test for buyers is whether their traffic pattern actually hits that window. The default time-to-live is 5 minutes, with select models supporting up to 1 hour, and requests after expiry trigger a new cache write at the higher rate. Model choice also matters, since Anthropic Claude Sonnet 4.5 and Sonnet 4.6 need at least 1,024 tokens per checkpoint while Opus models need at least 4,096. Teams sending long documents or stable system prompts on a regular cadence are likely to see the clearest benefit, while sporadic or small-payload workloads may find the write premium harder to justify.

FAQ
What is the difference between cacheWriteInputTokens and cacheReadInputTokens?
cacheWriteInputTokens are tokens written to the cache on the first request and cost 25 percent more than standard input. cacheReadInputTokens are tokens read from the cache on later requests and cost 90 percent less than standard input.
How much can I save if I send one document with several questions?
For repeated context, Amazon says savings reach approximately 75 percent on input token costs. That assumes all later requests happen within the cache time-to-live window.
Are there minimum size requirements for caching to work?
Yes. Each cache checkpoint must meet a minimum token threshold. For example, Anthropic Claude Sonnet 4.5 and Sonnet 4.6 require at least 1,024 tokens per checkpoint, while Opus models require at least 4,096.
Amazon AI BlogRead Original Article

Get the latest Large Language Models news every morning

For example, today's edition would include:

  • Meta One launches globally from $2.99/moTop Companies AI · 56m ago
  • Perplexity's Portable Computer hits Windows with NvidiaTop Companies AI · 56m ago
  • NEC runs 10-day AI-only department test with agent 1on1sTop Companies AI · 56m ago

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleEx-Google DeepMind researcher Bilal Chughtai warns AI could kill us all