AIToday
AI Coding AssistantsAI Business & IndustryAmazon AI BlogPublished: Aug 12, 2026, 04:00 JST6 min read

First Orion cuts QA cycles 20–25% using Amazon Nova Act AI agents

First Orion cuts QA cycles 20–25% using Amazon Nova Act AI agents

Key takeaway

  • First Orion, a US-based communications company, adopted Amazon Nova Act—an AI agent that understands web interfaces—to automate QA testing by letting analysts describe tests in plain English rather than write code.

  • The shift cut QA cycle time from days to minutes for supported scenarios and reduced QA cycles by 20–25 percent, freeing up 25–30 percent of engineering time previously spent supporting QA.

  • As First Orion expands the system to more application modules, further efficiency gains are expected.

3 Key Points

  1. What happened

    First Orion, a branded communications company reaching hundreds of millions of calls across US, Canada, UK, and Germany carriers, adopted Amazon Nova Act to replace script-based test automation with AI agents that understand web interfaces in natural language. QA analysts now write test cases in plain English (e.g., "Log into the portal, navigate to billing, and verify the invoice total") instead of maintaining brittle code-based selectors; the model reasons about the UI state and executes multi-step sequences autonomously.

  2. Why it matters

    First Orion's shift to a decentralized, modular architecture multiplied their web applications and testing burden, causing UI testing to become a bottleneck and stalling release velocity. Nova Act cuts the turnaround from test case definition to automated execution from days to minutes, eliminating the brittleness that forced rewrites after every sprint. The company estimates saving 25–30 percent of engineering time previously consumed by QA support, freeing capacity for feature work instead.

  3. What to watch

    First Orion has achieved a 20–25 percent reduction in QA cycles for specific testing types and expects further efficiency gains as coverage expands to additional application modules. The company built an end-to-end system integrating the Nova Act SDK with a React test-authoring UI, Amazon S3 test storage, Amazon ECS/Fargate execution, Allure reporting, and AgentCore Browser session recording—a template other enterprises may adapt.

In Depth

Read the full story

First Orion, founded in 2008 and now operating with over 300 team members across offices in North Little Rock, Seattle, London, and Dubai, is a branded communications company whose solutions reach hundreds of millions of phone calls across carriers in the US, Canada, UK, and Germany. Their product suite includes INFORM Branded Calling, ENRICH Branded Messaging, AFFIRM Number Monitoring, SENTRY Call Blocking, and PROTECT+ Risk Detection. As they expanded their market reach and shifted to a decentralized, cell-based architecture where each team owns product-specific applications, the scope of QA testing multiplied. Device form factors and browser versions proliferated, and test coverage could not keep pace with development velocity.

Three specific problems crippled the incumbent automation frameworks. First, regression testing was not self-service; developers needed straightforward ways to run tests before shipping to the test environment, but existing test cases carried extensive dependencies that made them fragile and difficult to execute on demand. Second, new features suffered from a test case gap: QA Automation Engineers had to wait until features were deployed to the test environment before they could identify the DOM selectors and labels needed to write tests, forcing QA Analysts to context-switch while waiting and mounting cognitive load as features shipped in rapid succession. Third, the test scripts themselves were brittle; element IDs, CSS classes, and JavaScript attributes changed faster than Automation Engineers could fix them, making traditional Selenium and Playwright automation incapable of keeping pace with release cycles.

When Amazon's account team introduced First Orion to Amazon Nova Act in March 2025, First Orion became a pre-release adopter. Instead of writing code describing how to navigate a UI, Nova Act lets QA Analysts describe what to test in plain English—for example, "Log into the portal, navigate to billing, and verify the invoice total"—and the agent reasons about the current UI state, identifies elements, and runs multi-step sequences autonomously. Unlike Selenium and Playwright, Nova Act does not rely on fixed selectors; it reasons about labels, layout, and context, so a command like "click the Submit button" works regardless of underlying CSS classes. The model adapts to changing page layouts, handles dynamic content, dismisses pop-ups, and recovers from errors without human intervention.

First Orion built an end-to-end system integrating the Nova Act SDK with a React frontend for test case authoring, Amazon S3 for test storage, Amazon ECS with AWS Fargate for orchestration, and Amazon Bedrock AgentCore Browser for managed browser provisioning and session recording. QA analysts browse, create, edit, and validate test cases in plain English through the React UI; a custom templating engine handles dynamic variables like phone numbers and email addresses so the same test collection generates unique, realistic data on every run. When a QA analyst triggers a test, the Nova Act Test Runner picks up test cases from S3 and delegates browser operations to AgentCore Browser, which handles MFA without requiring changes to the target application's auth flow. Results flow into an Allure reporting dashboard with Microsoft Teams integration, and AgentCore provides session recording with video replays linked directly in the reports.

The results have been substantial. The turnaround from test case definition to automated execution dropped from days to minutes for supported scenarios—a process that previously required QA Automation Engineers to manually identify DOM selectors, write scripts, debug brittle selectors, and iterate over days. First Orion achieved a 20–25 percent reduction in QA cycles for specific types of testing and estimates saving 25–30 percent of engineering time with Nova Act, decreasing context switches between features. Engineering capacity previously needed to support QA has been redirected to feature engineering and value creation. As coverage expands to additional application modules, First Orion expects further efficiency gains.

Context & Analysis

First Orion faced a classic scaling problem: as they expanded from a monolithic portal to a decentralized, product-specific architecture and pushed into the small and medium-sized business market, their web applications multiplied faster than their QA team could test them. The range of device form factors and browser versions their customers used grew significantly, compounding the testing burden. Traditional test automation frameworks like Selenium and Playwright became bottlenecks because they relied on brittle element selectors (CSS classes, IDs) that broke with every UI change, forcing QA Automation Engineers to spend days rewriting and debugging scripts rather than writing new tests.

The core problem was structural: QA Analysts could define test cases in plain English, but Automation Engineers had to wait for features to deploy to the test environment before they could identify DOM selectors and write code. This dependency forced context-switching and delayed test coverage. Meanwhile, selector-based tests failed constantly as the UI changed, consuming engineering cycles on regressions instead of new capabilities. Increasing headcount did not address the root cause.

Amazon Nova Act solved both constraints by reasoning about what the agent sees on screen—labels, layout, and context—rather than relying on fixed selectors. QA Analysts can now author tests directly in plain English without waiting for Automation Engineers to translate them into code, and those tests survive UI changes because they do not depend on brittle selectors. First Orion built an end-to-end system around the Nova Act SDK that integrates test authoring, execution via AgentCore Browser, and reporting, effectively collapsing the days-to-minutes cycle and freeing engineering capacity from QA support to feature work.

FAQ

How much faster is test automation with Nova Act compared to the old approach?
The turnaround from test case definition to automated execution dropped from days to minutes. First Orion achieved a 20–25 percent reduction in QA cycles for specific types of testing.
What does a Nova Act test case look like?
QA analysts write instructions in plain English, such as "Navigate to the Billing page, verify the invoice total matches the expected amount, and download the PDF." The Nova Act SDK translates these into browser actions at runtime without requiring element selectors or programming knowledge.
What engineering time savings did First Orion report?
First Orion estimates saving 25–30 percent of engineering time with Nova Act, decreasing context switches between features and redirecting capacity previously needed to support the QA function toward feature engineering and value creation.
Amazon AI BlogRead Original Article

Get the latest AI Coding Assistants news every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articlePalantir Stock Down 0.5% Despite 93% Revenue Growth

The AI news that matters, in one minute each morning.

Sign up free