
First Orion, a US-based communications company, adopted Amazon Nova Act—an AI agent that understands web interfaces—to automate QA testing by letting analysts describe tests in plain English rather than write code.
The shift cut QA cycle time from days to minutes for supported scenarios and reduced QA cycles by 20–25 percent, freeing up 25–30 percent of engineering time previously spent supporting QA.
As First Orion expands the system to more application modules, further efficiency gains are expected.
What happened
First Orion, a branded communications company reaching hundreds of millions of calls across US, Canada, UK, and Germany carriers, adopted Amazon Nova Act to replace script-based test automation with AI agents that understand web interfaces in natural language. QA analysts now write test cases in plain English (e.g., "Log into the portal, navigate to billing, and verify the invoice total") instead of maintaining brittle code-based selectors; the model reasons about the UI state and executes multi-step sequences autonomously.
Why it matters
First Orion's shift to a decentralized, modular architecture multiplied their web applications and testing burden, causing UI testing to become a bottleneck and stalling release velocity. Nova Act cuts the turnaround from test case definition to automated execution from days to minutes, eliminating the brittleness that forced rewrites after every sprint. The company estimates saving 25–30 percent of engineering time previously consumed by QA support, freeing capacity for feature work instead.
What to watch
First Orion has achieved a 20–25 percent reduction in QA cycles for specific testing types and expects further efficiency gains as coverage expands to additional application modules. The company built an end-to-end system integrating the Nova Act SDK with a React test-authoring UI, Amazon S3 test storage, Amazon ECS/Fargate execution, Allure reporting, and AgentCore Browser session recording—a template other enterprises may adapt.
First Orion, founded in 2008 and now operating with over 300 team members across offices in North Little Rock, Seattle, London, and Dubai, is a branded communications company whose solutions reach hundreds of millions of phone calls across carriers in the US, Canada, UK, and Germany. Their product suite includes INFORM Branded Calling, ENRICH Branded Messaging, AFFIRM Number Monitoring, SENTRY Call Blocking, and PROTECT+ Risk Detection. As they expanded their market reach and shifted to a decentralized, cell-based architecture where each team owns product-specific applications, the scope of QA testing multiplied. Device form factors and browser versions proliferated, and test coverage could not keep pace with development velocity.
Three specific problems crippled the incumbent automation frameworks. First, regression testing was not self-service; developers needed straightforward ways to run tests before shipping to the test environment, but existing test cases carried extensive dependencies that made them fragile and difficult to execute on demand. Second, new features suffered from a test case gap: QA Automation Engineers had to wait until features were deployed to the test environment before they could identify the DOM selectors and labels needed to write tests, forcing QA Analysts to context-switch while waiting and mounting cognitive load as features shipped in rapid succession. Third, the test scripts themselves were brittle; element IDs, CSS classes, and JavaScript attributes changed faster than Automation Engineers could fix them, making traditional Selenium and Playwright automation incapable of keeping pace with release cycles.
When Amazon's account team introduced First Orion to Amazon Nova Act in March 2025, First Orion became a pre-release adopter. Instead of writing code describing how to navigate a UI, Nova Act lets QA Analysts describe what to test in plain English—for example, "Log into the portal, navigate to billing, and verify the invoice total"—and the agent reasons about the current UI state, identifies elements, and runs multi-step sequences autonomously. Unlike Selenium and Playwright, Nova Act does not rely on fixed selectors; it reasons about labels, layout, and context, so a command like "click the Submit button" works regardless of underlying CSS classes. The model adapts to changing page layouts, handles dynamic content, dismisses pop-ups, and recovers from errors without human intervention.
First Orion built an end-to-end system integrating the Nova Act SDK with a React frontend for test case authoring, Amazon S3 for test storage, Amazon ECS with AWS Fargate for orchestration, and Amazon Bedrock AgentCore Browser for managed browser provisioning and session recording. QA analysts browse, create, edit, and validate test cases in plain English through the React UI; a custom templating engine handles dynamic variables like phone numbers and email addresses so the same test collection generates unique, realistic data on every run. When a QA analyst triggers a test, the Nova Act Test Runner picks up test cases from S3 and delegates browser operations to AgentCore Browser, which handles MFA without requiring changes to the target application's auth flow. Results flow into an Allure reporting dashboard with Microsoft Teams integration, and AgentCore provides session recording with video replays linked directly in the reports.
The results have been substantial. The turnaround from test case definition to automated execution dropped from days to minutes for supported scenarios—a process that previously required QA Automation Engineers to manually identify DOM selectors, write scripts, debug brittle selectors, and iterate over days. First Orion achieved a 20–25 percent reduction in QA cycles for specific types of testing and estimates saving 25–30 percent of engineering time with Nova Act, decreasing context switches between features. Engineering capacity previously needed to support QA has been redirected to feature engineering and value creation. As coverage expands to additional application modules, First Orion expects further efficiency gains.
First Orion faced a classic scaling problem: as they expanded from a monolithic portal to a decentralized, product-specific architecture and pushed into the small and medium-sized business market, their web applications multiplied faster than their QA team could test them. The range of device form factors and browser versions their customers used grew significantly, compounding the testing burden. Traditional test automation frameworks like Selenium and Playwright became bottlenecks because they relied on brittle element selectors (CSS classes, IDs) that broke with every UI change, forcing QA Automation Engineers to spend days rewriting and debugging scripts rather than writing new tests.
The core problem was structural: QA Analysts could define test cases in plain English, but Automation Engineers had to wait for features to deploy to the test environment before they could identify DOM selectors and write code. This dependency forced context-switching and delayed test coverage. Meanwhile, selector-based tests failed constantly as the UI changed, consuming engineering cycles on regressions instead of new capabilities. Increasing headcount did not address the root cause.
Amazon Nova Act solved both constraints by reasoning about what the agent sees on screen—labels, layout, and context—rather than relying on fixed selectors. QA Analysts can now author tests directly in plain English without waiting for Automation Engineers to translate them into code, and those tests survive UI changes because they do not depend on brittle selectors. First Orion built an end-to-end system around the Nova Act SDK that integrates test authoring, execution via AgentCore Browser, and reporting, effectively collapsing the days-to-minutes cycle and freeing engineering capacity from QA support to feature work.
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytime
Ask AI anything about this article. Q&As are published on this page for other readers too.
Silicon Motion announced a private placement of US$1 billion in aggregate principal amount of 0% convertible s…

Sundar Pichai, CEO of Alphabet and Google, announced on August 11 that the Gemini app's monthly active users (…

OpenAI's ChatGPT crossed 1 billion monthly users some time ago and hit 1 billion weekly users in July, accordi…

OpenAI's Daybreak Red (GPT-5.6 Cyber) and Daybreak Blue (GPT-5.6 Sol) are now available to eligible customers…

IBM and Together AI have signed a $240 million agreement to build and operate an Nvidia-powered AI inference c…

NVIDIA and partners released multiple open-source AI models optimized for local execution throughout August, i…

The AI news that matters, in one minute each morning.
Sign up free