
Summaries like this, in your inbox every morning.
Sign up free →Researcher identified numerical instability in ssm_conv1d tensor layers (blocks 36-38) responsible for long-context memory in quantized Qwen models
Wasserstein metric (W1) proved significantly more effective than Kullback-Leibler divergence for detecting tensor drift, reducing instability scores from 0.0026-0.0040 to 0.0006-0.0009
Same drift bug was found in Unsloth quantizations, suggesting the Qwen team may be unaware of this specific SSM layer issue
Fixed model released on Hugging Face as Qwen3.6-35B-A3B-Uncensored-Wasserstein-GGUF, based on HauhauCS's aggressive quantization variant
No discussion yet for this article
Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.
Get Started FreeFree · takes 30 seconds · unsubscribe anytime
1 minute a day. The AI essentials.
200+ sources · Email / LINE / Slack