AIToday

Developer discovers and fixes tensor drift bug in Qwen3.6-35B using Wasserstein metric for improved GGUF quantization stability

r/LocalLLaMAApr 19, 20261 min read
Developer discovers and fixes tensor drift bug in Qwen3.6-35B using Wasserstein metric for improved GGUF quantization stability

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. Researcher identified numerical instability in ssm_conv1d tensor layers (blocks 36-38) responsible for long-context memory in quantized Qwen models

  2. Wasserstein metric (W1) proved significantly more effective than Kullback-Leibler divergence for detecting tensor drift, reducing instability scores from 0.0026-0.0040 to 0.0006-0.0009

  3. Same drift bug was found in Unsloth quantizations, suggesting the Qwen team may be unaware of this specific SSM layer issue

  4. Fixed model released on Hugging Face as Qwen3.6-35B-A3B-Uncensored-Wasserstein-GGUF, based on HauhauCS's aggressive quantization variant

Discussion

No discussion yet for this article

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →