AIToday
Large Language ModelsOpen-Source AIAI Business & IndustrySnowflake AI BlogPublished: Aug 24, 2026, 01:03 JST3 min read

Snowflake adds smart model routing to cut AI costs by up to 75%

Snowflake adds smart model routing to cut AI costs by up to 75%

Key takeaway

  • Snowflake launched dynamic model routing to automatically match AI requests to the cheapest capable model, reducing unnecessary spending on frontier AI.

  • Internal tests show data pipelines cut token use by up to 3× while maintaining output quality.

  • The company also released access to DeepSeek-V4-Flash 0731 and GLM-5.3, open models that let teams balance cost and performance for different workloads.

3 Key Points

  1. What happened

    Snowflake introduced dynamic model routing in Cortex AI Gateway, which automatically selects the most cost-effective AI model for each task without sacrificing quality. The company also expanded its open-model offerings to include DeepSeek-V4-Flash 0731 (in private preview) and GLM-5.3 (private preview coming soon).

  2. Why it matters

    Organizations deploying AI agents often default to expensive frontier models for every request, driving up costs without proportional gains in output quality. Snowflake's routing layer lets teams match routine tasks to cheaper, efficient models while reserving powerful models for complex work. Internal testing showed token efficiency improvements of up to 3× on data pipelines and 25% fewer tokens on coding tasks with comparable quality.

  3. What to watch

    DeepSeek-V4-Flash 0731 scores 74.4% on ADE-bench (a data engineering evaluation) and outperforms the leading proprietary model Snowflake tested; GLM-5.3 is designed for high-volume, self-hosted workloads where cost and latency are priorities. Both models run within Snowflake's governance boundary, keeping customer data on-platform rather than proxying through third-party APIs.

Ask the AI about this article →

Context & Analysis

AI spending is rising faster than measurable business value, prompting organizations to reconsider whether every task truly needs a state-of-the-art model. Snowflake's response centers on two linked capabilities. Dynamic routing removes the friction of manual model selection by letting administrators set quality thresholds and compliance rules once, then allowing the system to pick the lowest-cost model that meets those requirements for each request. As the routing layer learns from real-world workloads, it can adapt to changing model capabilities and pricing without requiring teams to rebuild applications.

The expansion of open-model access strengthens that routing layer by creating a wider pool of cost-effective options. DeepSeek-V4-Flash 0731's 74.4% score on ADE-bench—matching or beating proprietary models in data engineering tasks—signals that open-source models have reached parity on the benchmarks that matter most to enterprise data teams. GLM-5.3's strength on ADE-bench with minimal token footprint appeals to organizations running high-volume, self-hosted workloads where cumulative inference cost drives total spend.

By operating the full stack—data, compute, model weights, and agent orchestration—Snowflake avoids latency and cost penalties from data transfer and can optimize routing for patterns unique to enterprise workloads rather than generic API endpoints. The combination of automated routing and a growing pool of capable, efficient models creates a feedback loop: as new models arrive and existing ones improve, a larger fraction of requests can be handled by cheaper models while business outcomes remain constant, allowing costs-per-outcome to decline over time.

FAQ

How much does dynamic model routing save?
Internal testing showed a data build tool pipeline achieved up to three times greater token efficiency compared to a frontier-model-only approach with comparable quality. In a separate coding workload test, engineering teams maintained the same pull-request throughput while using approximately 25% fewer tokens.
When is dynamic model routing available?
Dynamic model routing through Cortex AI Gateway is coming soon (marked as PrPr). DeepSeek-V4-Flash 0731 is available in private preview today; GLM-5.3 is in private preview coming soon, subject to change based on model availability.
How does Snowflake serve these open models?
Snowflake hosts the open models directly rather than proxying a third-party API, so inference runs within Snowflake's secure environment and governance boundary. This keeps customer data within the same role-based access control and audit trail that govern their existing data.
Snowflake AI BlogRead Original Article

Get the latest Large Language Models news every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleOneiric open source AI video generator released