Nvidia announced Nemotron 3.5 Lightning, a customizable open AI model designed for enterprise agents, alongside NeMo Switchyard, a routing system that directs tasks to the most suitable model at each workflow step.
Lightning is a 30 billion-parameter mixture-of-experts model that delivers up to four times faster output and 30% faster task completion than comparable models, while remaining inexpensive to fine-tune on enterprise hardware with proprietary data.
The releases address the reality that enterprises need different models for different tasks—cheap models for simple work, powerful models for complex reasoning—rather than relying on a single expensive model for everything.
What happened
Nvidia announced Nemotron 3.5 Lightning, a 30 billion-parameter open model designed for high-volume agentic AI tasks, and NeMo Switchyard, an open-source routing library that directs prompts to the most capable model for each step of an agent workflow. Lightning delivers up to four times the output speed and 30% faster agentic task completion compared with other models in its weight class, and can be customized on enterprise hardware with proprietary data.
Why it matters
As enterprises deploy AI agents that must handle tasks of varying complexity—from simple sorting to deep reasoning—no single model fits all purposes. Lightning's low cost and ease of customization (one partner trained a router agent for $85 in two hours) let companies tailor models to their own domain data without expensive infrastructure. Switchyard lets them route each task to the most efficient model available, cutting costs and improving accuracy instead of defaulting to a single expensive model for all work.
What to watch
Nvidia is releasing its post-training datasets and the recipes used to train the models, allowing developers to blend Nvidia's data with their own. The company is collaborating with partners including Boomi LP, Cadence Design Systems Inc., Classmethod Inc., Cognition AI Inc., Kong Inc., Langchain Inc., Nous Research Inc. and Siemens AG on intelligent model routing integration.
Ask the AI about this article →
Nvidia's announcement reflects a fundamental shift in enterprise AI deployment: the era of picking a single "best" model for all tasks is ending. As AI agents handle diverse workloads—some requiring speed and efficiency for simple classification, others demanding reasoning depth—enterprises face a cost and accuracy optimization problem that no monolithic model can solve. Lightning addresses the customization bottleneck by making fine-tuning cheap and fast enough to run on modest hardware; Switchyard addresses the routing problem by letting developers orchestrate multiple models based on real-time task requirements.
The strategy leverages Nvidia's position in enterprise infrastructure. By open-sourcing both the model and the routing framework, and by releasing training datasets and recipes, Nvidia increases adoption friction for competitors while building a de facto standard for multi-model orchestration. The early partner examples—CodeRabbit training a router for $85, another partner integrating Lightning with zero pipeline changes—suggest the barrier to entry is genuinely low. This matters because it shifts the competitive advantage from raw model capability to the software stack that lets enterprises extract value from multiple models efficiently.
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
Israeli startup DataAgent Ltd
Taoyuan is positioning itself as a northern hub for AI data centers (AIDC), citing the Tatan area and an LNG c…
SK Hynix presented a custom HBM concept at SEMICON Taiwan 2026, where compute functions are placed in the base…
The U.S. Department of Defense announced on August 31 that it has deployed ChatGPT Mil, a customized version o…
Nvidia reported earnings that were both remarkable and boring, reflecting its focus on avoiding a consolidated…
Anthropic has agreed to a $35bn cloud-computing contract with Lambda, a Nvidia-backed cloud provider
