AIToday
Large Language ModelsAI Safety & AlignmentOpen-Source AITHE DECODERPublished: Nov 7, 2026, 22:01 JST

Nous Research strips Qwen3.8-27B propaganda to under 1% with Arete-27B

Send on LINE
Nous Research strips Qwen3.8-27B propaganda to under 1% with Arete-27B

3 Key Points

  1. What happened

    Nous Research fine-tuned Alibaba's Qwen3.8-27B on 53 million tokens to create Arete-27B, which reduced its propaganda rate from 22 percent to 0.9 percent and raised factual accuracy from 2.32 to 2.98 out of 5.

  2. Why it matters

    The result suggests the pro-Beijing bias in such models is a shallow layer that can be removed with targeted fine-tuning, not something baked deeply into the model.

WHO IT HITSThis matters for organizations deploying open-weight Chinese AI models, who may now consider fine-tuning as a way to remove state-aligned bias before use.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The release comes as Chinese open-weight models rank among the strongest available, but according to Nous they carry state-mandated behavior baked into their weights. With Qwen3.8-27B, the team observed refusals, evasive answers, and responses aligned with the Chinese Communist Party. To measure this, Nous built a test with 803 prompts across seven categories, using Grok 4.7 as the judge model to check whether responses mention, omit, or contradict predefined facts.

Nous chose Inkling from Thinking Machines Lab as its teacher model because an open model wouldn't break terms of service that ban distillation. The team also considered Nvidia's Nemotron 3 Ultra but noted signs of irregularities on China-related topics, suspecting the bias carried over from training on Chinese open-weight models. The training data for Arete-27B is spread nearly evenly across the seven value categories, with most examples running under 1,000 tokens.

The result adds to a growing body of evidence on Chinese model bias. In 2025, NewsGuard found that five leading models, including Qwen, repeated or failed to correct pro-Chinese disinformation in 60 percent of cases. CrowdStrike found that DeepSeek produces less secure code when queries reference Falun Gong, Tibet, or Taiwan. A study by Aleph Alpha with 967 politically sensitive questions reached similar conclusions: among models from Alibaba, DeepSeek, and Moonshot AI, only 17 to 41 percent of answers were balanced. Nous Research itself raised $90 million in a Series B round in October at a $1.5 billion valuation, with Robot Ventures leading and Nvidia and Samsung among the participants.

FAQ
How did Nous Research reduce the propaganda rate?
It used supervised fine-tuning on about 53 million tokens over two epochs, without reinforcement learning or preference optimization.
Did the fine-tuning hurt the model's general capabilities?
According to Nous, general capabilities remained intact: on its internal Hermes Bench, Arete-27B scored 65.60 percent versus 65.77 percent for the base model.
What is the propaganda rate of Western models for comparison?
Western models like Mistral Large 4 and Gemma 4 31B came in below one percent, while GLM-5.3 and DeepSeek V4.1 Flash landed at 15 and 16 percent.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleKorn Ferry: only 6% say top execs ready to lead AI