
What happened
AWS published guidance that routes workflow steps through three questions—can a rule check success, can a model write the rule once, is the answer from a fixed list—and sends only open-ended work to a right-sized Amazon Bedrock model.
Why it matters
Teams that default to model calls for every step pay per-token costs, add hundreds of milliseconds of latency, and get non-deterministic output that is harder to audit.
Summaries like this, every morning.
The guidance starts from a common pattern: a model call works for one step in a prototype, so it becomes the default for the next, and at production volume those small calls become one of the largest line items in the architecture. AWS frames the decision as a flowchart with three lanes—runs as code, questions, and runs on a model—and walks a customer support assistant through five steps to show how each maps to a specific AWS service. For steps that sit between a rule and open-ended generation, such as routing or classification, AWS describes a constrained decision call that picks from a fixed list and escalates when unsure, and it lists four implementation options including an experimental open source model, Strands Decider, whose README reports that answers at a confidence of 0.9 or more are right about 95 percent of the time on short classification tasks. AWS also recommends treating model choice as a tested configuration, with a golden evaluation set run in continuous integration and a configuration flag to reverse a swap.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
Tricentis's Quality Transformation Report 2026 found 60% of companies globally and 65.6% in Japan deploy untes…

At Microsoft Ignite 2026, Microsoft announced MAI Code 2, which reaches 98% of GPT 6.1 Sol's and 96% of Claude…

Jordan Belfort's AI voice startup Tone has brought in about $1 million in revenue and targets $20 million to $…

Microsoft introduced Copilot Workspaces, a collaborative space in its Frontier early-access program where Word…

Earlier in November, Meta chief AI officer Alexandr Wang shared an AI-generated clip on Instagram promoting Mu…

At a roundtable after his Microsoft Ignite keynote at San Francisco's Chase Center, Satya Nadella said he is "…
