Half of enterprises have deployed AI agents that passed internal tests but still failed in customer-facing production, yet 66% are already moving toward autonomous deployment without human review.
Only 5% fully trust the automated evaluations supposed to guard those releases, creating a gap between the speed of automation and the assurance companies have in their testing systems.
What happened
A June 2026 survey of 157 enterprise respondents found that half had deployed an AI agent or LLM feature that passed internal evaluations yet still caused a customer-facing failure; one in four experienced such a failure more than once. Meanwhile, 66% of respondents already permit some production deployment without human review or are building systems to do so within the next 12 months.
Why it matters
Only 5% of enterprises fully trust the automated evaluations that would decide whether to release AI systems into production. This creates an evaluation gap—companies are giving agents more autonomy while their confidence in the testing systems that verify safety is collapsing, raising the risk of costly customer-facing problems.
What to watch
The survey is based on a self-selected sample of 157 qualified respondents at companies with 100 or more employees, so findings should be read as directional rather than precise.
Ask the AI about this article →
Enterprise AI deployment is facing a critical disconnect between speed and safety. The June 2026 VB Pulse survey reveals that despite internal testing processes, half of surveyed enterprises experienced customer-facing failures from AI agents and LLM features—a sign that current evaluation methods are not catching real-world problems before they reach users. More troubling, companies are not responding to these failures by tightening controls; instead, two-thirds are moving toward autonomous deployment with minimal or no human oversight.
The root cause appears to be a collapse in confidence in automated testing. While most enterprises are accelerating the autonomy of their AI systems, only one in twenty fully trusts the automated evaluations that are supposed to gate those deployments. This mismatch—rising autonomy paired with falling assurance—creates what the survey identifies as an "evaluation gap." Companies are accepting risk faster than they are building reliable ways to measure it. The data suggests that internal benchmarks and test suites designed in controlled environments are not translating to production robustness, and enterprises may be pursuing speed-to-market over validated safety, potentially at the cost of customer trust and operational stability.
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
CrowdStrike Holdings Inc
ASE Technology CEO and SEMI Global Board Executive Committee Chair Tien Wu said AI's early-stage growth is cre…

Fervo Energy signed a deal to supply 396 MW of electricity from its Cape Station project in Utah to a Google d…

Nvidia co-announced with Vertiv in August that it is making progress on 800-volt power infrastructure for its…

John Ternus takes over as CEO of Apple today, stepping into the role as the company confronts the AI era

Top AI-native open source projects like Flue and tldraw are refusing external pull requests, often because the…
