AIToday
Large Language ModelsOpen-Source AIAI Business & IndustrySnowflake AI BlogPublished: Aug 19, 2026, 16:01 JST3 min read

Snowflake adds dynamic routing to cut AI costs, expands open models

Snowflake adds dynamic routing to cut AI costs, expands open models

Key takeaway

  • Snowflake announced dynamic model routing that intelligently selects the right AI model for each task, reducing unnecessary reliance on expensive frontier models, and added access to open models like DeepSeek-V4-Flash and GLM-5.3.

  • Internal tests showed the routing approach achieved up to three times greater token efficiency on some workloads while maintaining comparable quality, enabling organizations to lower per-outcome AI costs without rebuilding applications.

3 Key Points

  1. What happened

    Snowflake introduced dynamic model routing in Cortex AI Gateway, which automatically directs requests to the least expensive model capable of completing each task, and expanded access to open models including DeepSeek-V4-Flash 0731 and GLM-5.3 in private preview.

  2. Why it matters

    Organizations currently overspend by using the most powerful model for every request, regardless of task complexity. By matching tasks to appropriate models and maintaining routing logic centrally, Snowflake lets customers reduce costs without requiring application rebuilds. Internal testing showed up to three times greater token efficiency on some workloads and approximately 25% fewer tokens for coding tasks while maintaining quality.

  3. What to watch

    DeepSeek-V4-Flash 0731 scored 74.4% on ADE-bench (a data engineering evaluation), outperforming the leading proprietary model tested. GLM-5.3 is arriving soon with self-hosting capability; GLM-5.2 previously scored 66% on ADE-bench with the lowest token footprint in that benchmark.

Ask the AI about this article →

Context & Analysis

Snowflake's announcement addresses a fundamental economic problem in enterprise AI deployment: the assumption that every task requires the most capable (and most expensive) model available. As organizations scale agent and AI application usage, this default behavior drives costs faster than measurable business value increases. By introducing dynamic model routing, Snowflake centralizes the intelligence-to-task matching at the infrastructure layer, eliminating the need for developers to hardcode model selection logic or rebuild applications as the model landscape evolves.

The expansion of open models matters because routing is only effective when there are meaningful cost and capability trade-offs to exploit. DeepSeek-V4-Flash's 74.4% score on ADE-bench—surpassing the proprietary model Snowflake tested—signals that the open-source frontier has narrowed the capability gap in data engineering and analytics tasks, a domain critical to enterprise customers. Similarly, GLM-5.2's combination of 66% accuracy with the lowest token footprint creates a distinct efficiency option for high-volume, cost-sensitive workloads. This portfolio diversity gives the routing layer multiple Pareto-optimal choices: customers can now match lower-complexity tasks to efficient models without sacrificing quality, while reserving expensive frontier models for workloads that genuinely require them.

The self-hosting capability and Snowflake's decision to serve models within its own governance perimeter (rather than proxying third-party APIs) reinforce an enterprise control story. By keeping inference, data, model weights, and orchestration within Snowflake's boundary, organizations maintain a single audit trail and role-based access control, reducing compliance friction and data-residency concerns—practical considerations that often block open-model adoption in regulated industries.

FAQ

How much did costs drop in Snowflake's internal tests?
In one internal evaluation, dynamic model routing completed a data build tool pipeline with up to three times greater token efficiency than using a frontier model alone. In a separate coding test, engineering teams maintained the same pull-request throughput while using approximately 25% fewer tokens.
How does Snowflake serve these open models?
Snowflake hosts the open models itself rather than proxying a third-party API, ensuring inference runs within Snowflake's secure perimeter and governed data boundaries. This means your data stays within Snowflake's role-based access control and audit trail.
What are the performance scores of the new open models?
DeepSeek-V4-Flash 0731 scored 74.4% on ADE-bench (Snowflake's internal data engineering benchmark), outperforming the leading proprietary model tested. GLM-5.3 is coming soon; its predecessor GLM-5.2 scored 66% on ADE-bench with the lowest token footprint of any model in the benchmark.
Snowflake AI BlogRead Original Article

Get the latest Large Language Models news every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleChatGPT Ads expands to 31 European markets

The AI news that matters, in one minute each morning.

Sign up free