Artemis Security launches Orion-1, claims 80.8 vs 58.3

Artemis Security only came out of stealth in April, disclosing $70 million from seed and Series A rounds about six months after the company was founded. Orion-1 is its attempt to address a problem the company describes: general-purpose models lose track when fed billions of events or flag harmless but odd activity as an attack. Artemis says it fine-tuned Orion-1 on tasks drawn from its own security operations, including spotting suspicious patterns in log data, hunting for known attack techniques, writing new detection rules, and containing live attacks.

The launch lands as security teams are finding broad frontier models harder to work with. OpenAI considers its Astra model the first that could reach the highest cybersecurity risk tier, where a model could develop and run cyberattacks on its own. Claude Opus 5.5 routes most cybersecurity tasks to the older Opus 4.8, and when Hugging Face tried in July to analyze a fully autonomous AI attack on its own infrastructure using commercial frontier models, their guardrails blocked the analysis of the attack data entirely. The team ended up switching to the open-weight model GLM 5.2 running on its own servers. For defense, providers are shipping specialized models with restricted access instead: OpenAI only hands out the less restricted GPT-5.5-Cyber to verified defenders, and Anthropic takes a similar approach with its strongest model, running Claude Mythos 5 through the Claude Security scanner and partner security products.

Artemis built its own benchmark for the comparison, called Decision-Grade Readiness. Most existing security tests quiz models on attack techniques or have them solve hacking puzzles, but DGR gives every model the same initial alert, the same environmental data, and the same tools a security team would have, then asks it to decide whether an attack is underway. The thousands of tasks all have known outcomes, and some contain no attack at all or include benign data designed to look malicious. Models are scored on both their verdict and the evidence they present. Artemis reports results across five tasks and tested Grok 4.7 and Kimi K3 alongside Opus 5.5 and GPT-6 Sol, though both Mythos 5 and OpenAI's strongest model, GPT-6 Astra, are missing from the comparison, and with Opus 5.5 the benchmark results may largely reflect answers from the older Opus 4.8.