Open-Source AI
May 31, 2026
The Gist
Open-source AI development accelerated this week with new tools making powerful language models more accessible. NVIDIA released a compressed version of Qwen3.6 AI model that runs 3 times faster while using less memory. Meanwhile, independent developers created new tools for business automation and e-book translation that anyone can download and modify for free.
Today's Stories
- 1
NVIDIA releases compressed Qwen3.6 AI model that runs 3x faster with same accuracy
NVIDIA partnered with Alibaba to release a compressed version of the Qwen3.6-35B AI language model on May 30th. The new version reduces file size and memory requirements by approximately 3 times while maintaining the same accuracy on reasoning and math problems. This makes powerful AI models accessible to more users who don't have expensive computer hardware.
Businesses and researchers can now run advanced AI models on cheaper computers, potentially reducing costs for AI-powered applications and making them available to smaller companies.
- 2
Developer creates Maven, an open-source tool to replace expensive business automation services
A consultant released Maven, an open-source alternative to paid automation tools like Zapier, on May 31st. The tool combines AI agents (automated assistants) with workflow automation for tasks like lead qualification, email management, and business reporting. Unlike commercial services that charge monthly fees, Maven can be downloaded and customized for free.
Small businesses can automate repetitive tasks without paying subscription fees to multiple services, potentially saving hundreds of dollars monthly while maintaining full control over their data.
- 3
New benchmark tool reveals Windows matches Linux speed for running AI models locally
A comprehensive test published May 31st found no significant performance difference between Windows 11 and Linux when running large AI language models using llama.cpp software. The test used multiple high-end graphics cards and dispels the common belief that Linux is always faster for AI workloads, particularly with medium and large models.
Users can run AI models on their preferred operating system without worrying about performance penalties, eliminating the need to switch to Linux solely for AI applications.
- 4
Korean developer launches AI-powered e-book reader with built-in translation
A developer released an open-source e-book reader that includes a compact AI translation model based on llama.cpp on May 31st. The application allows readers to instantly translate foreign language books without internet connection, targeting book lovers who want to read untranslated works in their native language.
Readers can access foreign language books immediately without waiting for official translations, expanding available literature while reading offline.
- 5
Researchers develop 'Llama Surgery' technique to make AI models run faster without retraining
Scientists published a method called 'Llama Surgery' that modifies existing AI language models to use less computational power without starting training from scratch. The technique injects sparse attention patterns (selective focus mechanisms) into pre-trained models like Llama 3.1, reducing processing requirements while maintaining performance.
Existing AI models can be made more efficient and cheaper to run without the massive time and cost investment typically required to retrain them completely.
- 6
X Square Robot releases Wall-OSS-0.5, open-source AI that controls robots without task-specific training
X Square Robot published Wall-OSS-0.5, an open-source vision-language-action model that can control robots for basic tasks without additional training for each specific job. The 4B parameter model successfully completed tasks like sorting blocks and stacking rings using only its general pre-training, demonstrating broader robot intelligence capabilities.
Robotics developers can build more versatile robots that adapt to new tasks without extensive programming for each specific application, potentially accelerating automation in homes and workplaces.
What to Watch
Look for more compressed AI model releases from major companies as the focus shifts toward making powerful AI accessible on consumer hardware. The success of open-source alternatives like Maven may prompt established automation companies to adjust their pricing or release their own open-source versions.
Sources
- I got tired of stitching together Zapier, VAs, prompts, and custom scripts for clients — so I built this
- 125 tok/s for Qwen3.6 q4xl on 2x 4060ti is insane perf/dollar
- nvidia/Qwen3.6-35B-A3B-NVFP4 · Hugging Face
- mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-MTP-GGUF just released !
- Speed difference between Windows 11 and Linux with llama.cpp: a myth when using medium and large MoE models
- Made a program using LocalLLM based on llama.cpp for fellow Book Lovers!
- Best small model right now (~4B params) that is good with agentic tasks for personal assistant?
- I built mlx-Chronos — a community benchmark leaderboard for local LLM engines on Apple Silicon (oMLX, Rapid-MLX, mlx-lm, Ollama) [P]
- Llama Surgery: Continuous Sparsification of Pre-Trained Language Models via Differentiable Ultrametric Topology Injection
- Robot foundation models keep hiding behind fine-tuning numbers. Wall-OSS-0.5 is trying a different approach
Share this with a friend
Send today's roundup to anyone who wants to keep up.
Get daily AI news free with AIToday
200+ AI sources, summarized in 1 minute. Email / LINE / Slack.
Sign up free