AIToday
Large Language ModelsAI Safety & AlignmentAI Business & IndustryArs Technica AIPublished: Jul 28, 2026, 10:01 JST

Microsoft's AI security tools score 12 points higher than Anthropic, Google, OpenAI on benchmark

Microsoft's AI security tools score 12 points higher than Anthropic, Google, OpenAI on benchmark

3 Key Points

  1. What happened

    Microsoft announced two AI security tools on Monday—MDASH with MAI-Cyber-1-Flash, which scored 96 percent on the CyberGYM benchmark (12 points higher than Anthropic's Mythos, and ahead of Google Gemini and OpenAI GPT), and Project Perception, a platform of specialized AI agents for red-, blue-, and green-team security functions. The new MDASH costs half as much to use as the previous MDASH offering.

  2. Why it matters

    Microsoft says Project Perception can perform 90 percent of security tasks for lower costs than competing platforms, leaving organizations to use costlier alternatives only for the remaining 10 percent of tasks. The tools respond to what Microsoft calls a seismic shift in how organizations defend against cyberattacks, as AI accelerates both the speed and scale of threats, forcing security teams to manage increasingly complex environments with outdated approaches.

  3. What to watch

    Both tools are currently in preview mode and should be closely scrutinized before use in production environments, though there are clear risks to not adopting such tools either. The balance between the risks of using AI agents versus the threat of avoiding them remains unresolved.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

Microsoft's announcement reflects an industry-wide tension: as artificial intelligence accelerates both the sophistication and speed of cyberattacks, traditional security approaches have become insufficient. The company frames the problem as one of scale and complexity—security teams must now process vast amounts of data and correlate signals across increasingly complex digital environments, yet they lack tools designed for this AI-driven threat landscape. By positioning MDASH and Project Perception as cost-effective alternatives to existing platforms, Microsoft suggests that price and performance have become differentiators in the security AI market.

The benchmark comparison—a 12-point advantage over Anthropic's Mythos and leads against Google and OpenAI's flagship models—serves as a key competitive claim, though the article notes that these tools warrant careful evaluation before production deployment. The emphasis on cost efficiency in Project Perception (performing 90 percent of tasks at lower expense) also points to a broader market shift: buyers are no longer purchasing monolithic security solutions but instead seeking platforms that intelligently allocate expensive, specialized models only where they are most needed. Both tools are in preview, indicating that real-world validation is still underway.

FAQ
How does the new MDASH compare to competitors on the CyberGYM benchmark?
MDASH with MAI-Cyber-1-Flash scored 96 percent on CyberGYM, which is 12 points higher than Anthropic's Mythos, and also beats Google Gemini and OpenAI GPT on the same test.
What does Project Perception do?
Project Perception is a collection of specialized AI agents that perform red-team (attack simulation), blue-team (defense), and green-team (corrective action) functions for finding vulnerabilities, investigating their risk, and taking corrective actions respectively. The platform automatically selects which models to use based on the assigned task, considering both model effectiveness and customer cost.
What cost advantage does Project Perception claim?
Microsoft said Project Perception can perform 90 percent of security tasks for lower costs than similar platforms from competitors, leaving customers to use more expensive alternatives only for the remaining 10 percent of tasks.
Ars Technica AIRead Original Article

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleAnthropic's Amodei: no ban on open models, but fears Chinese AI superiority