AIToday

86% of enterprises run AI agents at half GPU capacity or below

VentureBeat AI2d ago
86% of enterprises run AI agents at half GPU capacity or below

Key takeaway

Enterprise companies deployed AI agents faster than they could establish the controls to manage them safely, according to a survey of 573 technical leaders. The finding shows that roughly 6 in 10 enterprises now plan to add or switch vendors across five management layers within 12 months to catch up with governance standards they should have had in place from the start.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  • What happened

    A VentureBeat Research survey of 573 technical leaders at companies with 100+ employees found that enterprises deployed AI agents before implementing the management controls needed to oversee them. Roughly 6 in 10 enterprises plan to switch or add vendors across five control layers (identity, output evaluation, cost tracking, business context, and orchestration) within the next 12 months, with roughly a third planning to move within the quarter.

  • Why it matters

    The finding reveals a gap between deployment speed and operational readiness in enterprise AI. Companies are now retrofitting governance systems after the fact, suggesting that the rush to deploy AI agents outpaced internal preparedness. This indicates businesses recognize the risk and are actively budgeting to catch up with their own standards.

  • What to watch

    The survey covered five parallel assessments of the agentic stack across control layers—identity management, output evaluation, cost telemetry, business context, and orchestration—each showing similar patterns of vendor switching and remediation within a 12-month window.

Context & Analysis

The survey reveals a fundamental mismatch in enterprise AI deployment: companies prioritized speed-to-production over governance infrastructure. The fact that 86% of enterprises run GPUs at half capacity or below suggests not only underutilized hardware investment, but also that the rush to deploy agents left room for only partial workloads while management systems were retrofitted. This pattern—where enterprises knowingly deployed without controls in place—points to a broader industry dynamic in which proof-of-concept and competitive pressure to ship AI features outweighed operational discipline.

The remediation timeline the research uncovered is telling. That roughly 6 in 10 enterprises plan to change vendors within a 12-month window across all five control layers indicates not a one-time tuning problem, but a systematic rebuilding effort. The fact that roughly a third plan to move within the quarter suggests some enterprises face urgent governance gaps. This workload, spread across identity, evaluation, cost tracking, context, and orchestration, suggests enterprises are not addressing a single pain point, but rather building out an entire governance architecture they should have designed before deployment. The budgeting commitment implied by vendor-switching plans signals that enterprises now recognize the cost and risk of this approach—and are willing to pay to correct it.

FAQ

How many enterprises are planning to change vendors in the next 12 months?
Roughly six in 10 enterprises plan to switch or add vendors in each of the five control layers within the next 12 months, with roughly a third planning to move within the quarter, depending on the layer.
What are the five main control layers enterprises are working on?
Identity for agents (which agent is allowed to do what), evaluation of agent output (whether the work is good), cost telemetry (what each agent costs to run), the context layer (business data agents draw on), and orchestration control.

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →