
What happened
Amazon said prompt caching in Amazon Bedrock can reduce cached input token costs by up to 90 percent, letting a 10,000-token document be reused across many questions.
Why it matters
Instead of paying full price for a document every time, `cacheReadInputTokens` is billed at 90 percent below standard input, while the first write (cacheWriteInputTokens) costs 25 percent more than standard input.
What to watch
The savings depend on whether later requests arrive inside the time-to-live window, since the default is 5 minutes and expired requests trigger a new cache write at the higher rate.
WHO IT HITSThis lands hardest on developers and technical teams building Amazon Bedrock applications that repeatedly send the same long documents, system prompts, tool definitions, or tenant-specific context. Their core trade-off shifts from trimming prompts or context windows to managing cache lifetime and token thresholds.
Ask the AI about this article →
Summaries like this, in your inbox every morning.
Amazon's post frames prompt caching as an infrastructure-level fix for a familiar cost problem. Without caching, a 10,000-token contract sent alongside 50 user questions means 500,000 input tokens billed at full price, even though much of that content has already been processed. The article lays out three workarounds and their trade-offs: shortened prompts may reduce context quality, smaller context windows weaken reasoning over complete information, and response caching does nothing when the same context is paired with different questions. Prompt caching is presented as a fourth path that avoids those compromises.
The mechanics matter because they are where the savings come from. A cachePoint marker tells Amazon Bedrock to compare the preceding content against existing cache entries, scoped to individual AWS accounts and Regions. A cache hit skips reprocessing and starts generation from the cached state; a cache miss processes everything and writes a new entry. Amazon also lists two new token categories, cacheWriteInputTokens and cacheReadInputTokens, priced at 25 percent higher and 90 percent lower than standard input respectively. The 90 percent reduction applies to cache reads, and the approximately 75 percent net savings for a repeated document assumes later requests land inside the time-to-live window.
The practical test for buyers is whether their traffic pattern actually hits that window. The default time-to-live is 5 minutes, with select models supporting up to 1 hour, and requests after expiry trigger a new cache write at the higher rate. Model choice also matters, since Anthropic Claude Sonnet 4.5 and Sonnet 4.6 need at least 1,024 tokens per checkpoint while Opus models need at least 4,096. Teams sending long documents or stable system prompts on a regular cadence are likely to see the clearest benefit, while sporadic or small-payload workloads may find the write premium harder to justify.
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
Chevron jumped about 2.1% to $216.58 Tuesday afternoon as Brent crude climbed to $109.20 per barrel amid Saudi…

Walmart CEO John Furner is turning the retailer's 5,200 U.S

Coca-Cola President and CFO John Murphy told Yahoo Finance that AI is not 'the path forward' for the company's…

Perplexity released Portable Computer for Windows in partnership with Nvidia, via its existing Windows app

Meta introduced Meta One, a global subscription with 50+ features across Instagram, Facebook, WhatsApp, and Me…

Bank of America is replacing only 75% of employees who leave while doubling its budget for AI, per eFinancialC…
