Open-source AI models capture frontier traffic; mixture-of-experts shifts cost boundary

The article illustrates a fundamental shift in how the AI market is organizing itself. A year ago, the narrative was that all traffic would eventually consolidate toward the single best frontier model; instead, the market is splintering into distinct segments, each optimized for different trade-offs. OpenRouter's data—showing that a year-old open-source model retains 36% of the traffic of Anthropic's newest frontier offering—is evidence that buyers are choosing based on cost, latency, and accuracy rather than pure capability. This segmentation is not accidental; it is being driven by intentional competition. Anthropic's decision to ship Opus 5 as a smaller, cheaper model to contest Moonshot's Kimi 3, and Poolside's launch of Laguna S 2.1 as a US mid-market option, show that vendors are explicitly building for niches rather than chasing the frontier-only race.

The mixture-of-experts architecture breakthrough amplifies this trend by collapsing a key cost boundary. When a 118-billion-parameter model can decode at the speed of a 26-billion-parameter model, it shifts what is possible in local deployment. The author's real-world test—where Laguna reduced tool-call failure rates by 7 percentage points over its predecessor—suggests that this capability gap is practical, not just theoretical. The implication is that the local tier (where models run on a user's own device or a small instance) is no longer confined to small models; it can now access much larger, more capable architectures, provided the developer can afford the memory footprint at inference time.