Liquid AI releases 4-bit LFM2.5 models retaining 97% accuracy

Quantization—compressing neural networks to use fewer bits per weight—is a standard way to shrink models for edge deployment, but it typically degrades accuracy. Liquid AI's approach uses Quantization-Aware Distillation to sidestep this tradeoff: a full-precision teacher model guides the training of a 4-bit student, allowing it to learn patterns that preserve quality despite aggressive compression. The result is that LFM2.5 models in Q4_0 format (a standard 4-bit encoding) recover 96–97% of full-precision accuracy, bridging the gap between efficiency and capability.

The release matters because edge inference—running AI on phones, embedded systems, and small devices rather than in data centers—is constrained by memory and power. By maintaining accuracy while hitting the speed and memory targets of native Q4_0 quantization, these checkpoints make LFM2.5 practical for real-world deployment on heterogeneous hardware: GPU-accelerated devices like MacBooks and NucBox deliver 4–33% faster decoding, while ARM CPU devices like Raspberry Pi and Samsung phones can run the same models at competitive quality.