What happened
Liquid AI released two encoder models—LFM2.5-Encoder-230M and LFM2.5-Encoder-350M—on Hugging Face. Both support 8,192-token context and are optimized for CPU inference. LFM2.5-Encoder-350M ranks fourth among 14 models on GLUE, SuperGLUE, and multilingual benchmarks; LFM2.5-Encoder-230M beats ModernBERT-base and every EuroBERT model while being smaller than most.
Why it matters
The models enable businesses to run text classification, intent routing, PII detection, and document analysis on existing CPU hardware without cloud inference costs. At 8,192 tokens, LFM2.5-Encoder-230M is about 3.7× faster than ModernBERT-base on CPU (28 seconds versus over a minute and a half per forward pass), making it practical to scan a full contract or transcript on a laptop.
What to watch
Both models are open-weight and available now on Hugging Face. Live demos (prompt routing, policy linting, spell checking, PII detection) run in CPU-only spaces with no setup required. A fine-tuning tutorial covers adaptation to custom tasks on long legal documents at 8,192-token context.
Summaries like this, in your inbox every morning.
Liquid AI's new encoders address a persistent production-NLP need: running high-volume understanding tasks cheaply and fast on CPU. The company released LFM2.5-Retrievers for multilingual search last month; these encoders extend that family with a broader mandate, using masked-language pretraining instead of retrieval objectives so they can be fine-tuned for classification, token-level tasks, and search alike. The models inherit the fast-inference architecture of the LFM2 decoder backbone but flip it to bidirectional: each token sees neighbors on both sides, and short convolutions are padded symmetrically. Training happens in two stages—general language competence at 1,024 tokens on web text, then long-context adaptation extending to 8,192 tokens on a mixed corpus to strengthen factual, legal, and multilingual performance.
The benchmark results show LFM2.5-Encoder-350M ranks fourth among 14 models tested, with only three larger models ahead (including a 3.5B model nearly 10 times its size). LFM2.5-Encoder-230M outperforms ModernBERT-base on GLUE, SuperGLUE, and multilingual tasks despite being smaller. The speed advantage on CPU is dramatic: at 8,192 tokens, LFM2.5-Encoder-230M is about 3.7× faster than ModernBERT-base. On GPU, a similar pattern holds with a narrower margin—ModernBERT-base leads below ~1K tokens on Apple GPU, but LFM2.5-Encoders take the lead from about 2K tokens onward. For developers, this means scanning or classifying full documents (contracts, transcripts, long support threads) in under 30 seconds on a laptop CPU—a practical shift for always-on NLP applications.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
