AIToday
Large Language ModelsAI Safety & AlignmentQiita 機械学習Published: Oct 21, 2026, 16:00 JST

Qwen3-1.7B test: 100 LoRA minds, 10 generations, no bias flip

Send on LINE
Qwen3-1.7B test: 100 LoRA minds, 10 generations, no bias flip

3 Key Points

  1. What happened

    A preliminary experiment ran 100 copies of Qwen/Qwen3-1.7B, each with its own LoRA (small add-on weights acting as genes), through 10 generations of crossover and mutation. In one variant the average share of text about women rose to 0.5770 (its baseline was 0.4729).

  2. Why it matters

    Rewarding the length of text on women did not make the models say women are superior, suggesting that tuning word counts and changing a model's value judgments did not go together in this run — though the author calls this a single-seed exploratory observation, not a settled result.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The setup rests on a simple design choice: keep the base model frozen and let only the B half of each LoRA's update vary between individuals. That makes the experiment cheap enough for one person to run, but it also narrows what can evolve — only the add-on weights move, not the underlying model. Early on, this mattered a lot. With the initial scaling, every individual kept answering with a fixed 7 characters for women and 9 for men through generation 8, giving identical scores and nothing for selection to act on.

The two scored variants then diverged. When total length was rewarded, average answer length climbed from about 43.88 characters to 103.36, and one top individual padded its answer by repeating the same list of traits. When only women's length was rewarded, answers got shorter for both sexes, with men shrinking faster. The author's proposed explanation is that mutations making only one side more concise were hard to find, but flags that as a hypothesis the log cannot confirm.

The follow-up questions are the part that keeps the result modest. Separate answers about which sex is superior were never used in scoring, and none declared women the better sex. The author's next step is to separate whether selection merely reshapes answers to one fixed prompt or carries over to questions never used in breeding.

FAQ
Did rewarding more text about women make the models say women are better?
No. Across 40 checked answers the experiment found no response that explicitly named women the superior sex. The change stayed at the level of how many characters were devoted to each sex.
Why did the models get shorter when only women's text was rewarded?
The scoring formula compared women's characters against men's, so making men's section even shorter raised the score. The strongest parent candidates at generation 5 all gave 10 characters to women and 6 to men.
Is this a finished study on sex selection?
No. The author calls it a preliminary, single-seed exploratory run without a no-selection control series or multiple seeds, and says it does not establish the size or universality of any selection effect.
Qiita 機械学習Read Original Article
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleMeta's Muse leaks 6,800+ shared chats via URL titles