Gray Swan relaunches Arena 2.0 with $300,000 IPI Black contest

Gray Swan's overhaul comes as the AI applications companies deploy have shifted from chatbots to agents that browse the web and take actions. When the original Arena launched in September 2024, most applications were chatbots, and contestants could jailbreak models from all vendors relatively easily—open-source models from Chinese AI labs often succumbed within minutes, while models from OpenAI and Anthropic took many hours and usually about a day. Since then, labs have made models substantially more robust, and configuring agent test environments now requires significantly more technical expertise. That has narrowed the pool of capable red teamers, though Gray Swan says its roughly 15,000-person community has not shrunk thanks to its engagement efforts. The new Arena offers a more gradual, educational path with beginner challenges, training certificates, and a route for top performers to be invited into Gray Swan's red-teaming community. Arena insights also feed Gray Swan's commercial products, Shade and Cygnal, and the company has grown to 66 employees from around 15 at the start of this year, expanding from frontier labs to large enterprises.