GitHub unveils HydraFusion, a multi-model AI orchestrator

HydraFusion represents a new approach to AI coding assistance: instead of just choosing a single model, it dynamically orchestrates multiple models from different providers to handle tasks. The system treats workflow selection as an optimization problem, balancing quality, cost, and latency for each request. While the examples here are technical, the underlying idea is about getting the best result without always paying for the most powerful model.

The research preview is part of GitHub's effort to bring automated semantic routing between local, cloud, and compound models to developers. Early internal testing suggests the capability is at or better than the comparison model, but the official results are mixed. On TerminalBench 2.1, HydraFusion improved quality while cutting cost, but on DeepSWE and CheckpointBench it was slightly lower in quality, though still at similar levels while reducing costs.

The preview is designed to learn which tasks benefit from compound workflows. For now, GitHub recommends starting with well-scoped, single-prompt coding tasks. The company plans to improve multi-turn performance next. HydraFusion remains an active research project, and its results, models, and availability may change based on feedback.