Qwen 3.8 27B defaults to overthinking—change that setting first

Key takeaway

• Alibaba's Qwen research lab released Qwen 3.8 27B on August 16, 2026, a 27-billion-parameter open-source language model that runs on consumer hardware and supports vision tasks, code generation, and image annotation.

• The model ships with a default "xhigh" reasoning setting that causes excessive overthinking even on simple prompts—users should switch to "low" or disable reasoning to avoid multi-minute delays.

• While the 17GB model delivers impressive capability (vision bounding boxes, coding agents, tool use) on offline machines, inference speeds of 15–30 tokens per second lag behind cloud APIs, and upcoming optimizations like Multi-Token Prediction could improve performance by ~72%.

3 Key Points

Context & Analysis

FAQ

What is the default reasoning setting and why is it a problem?

The model defaults to "xhigh" reasoning effort, which causes it to spend excessive computation analyzing even mundane tasks. A simple "draw an SVG of a circle" prompt led the model to spend several minutes over-thinking the design, producing an elaborate animated circle instead of the requested simple shape. The author strongly recommends switching to "low" or disabling reasoning entirely on first use.

How fast is inference on local hardware?

The author measured 15–30 tokens per second on an M5 Max MacBook Pro and NVIDIA DGX Spark, compared to 74 tokens/second for OpenAI 5.6 Sol and 184/second for 5.6 Luna. Multi-Token Prediction optimization showed a ~72% speedup in early benchmarks, suggesting future improvements could narrow the gap.

Can it run coding agents and tool use locally?

Yes. The author successfully configured the model with Pi (a coding agent framework) to answer questions about code, generate Python scripts, and execute them locally. It also performed vision tasks like drawing bounding boxes around objects in photographs, demonstrating reliable tool-calling and long-context support.