AIToday
Large Language ModelsSimon Willison's WeblogPublished: Nov 4, 2026, 04:00 JST

Qwen 3.8 27B reads raw weights, names Pac-Man at 72%

Send on LINE
Qwen 3.8 27B reads raw weights, names Pac-Man at 72%

3 Key Points

  1. What happened

    Running the paper's game-identification prompts in LM Studio, Qwen 3.8 27B correctly named Pac-Man (72% confidence), Pong (75%) and Breakout (88%) from weights alone, but failed on Freeway.

  2. Why it matters

    A 17GB model on a laptop reproducing the paper's no-tools weight-reading feat suggests the skill is not confined to frontier systems, though one blogger's trial is not a benchmark.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The Sparks of Weight-Space Programming paper, by Rikiya Takehi, Jayden Teoh, Alex Zhang and Omar Khattab, bundled two claims: that frontier models can read raw weights without tools, and that with code they can edit other models to improve them. Simon Willison separates the two and tests only the first, using the paper's own exp1_which_game prompts, which differ only in the weights they contain.

His local trial with Qwen 3.8 27B is a single blogger's run, not a controlled benchmark, and it missed Freeway, the most obscure of the four Atari 2600 titles. Still, the fact that a 17GB model loaded in LM Studio with a long context window could name three games from floating point numbers alone, in 46m 12s to 1h 4m 54s per prompt, is the kind of replication that invites others to try.

Willison is careful about the wider narrative. He notes Matthew Honnibal's criticism that the paper conflates weight-reading with code-assisted updates, and Sean Goedecke's read that the Qwen3.5-0.8B fix follows steps a human researcher would take. His conclusion is that the paper is cool but does not justify declaring the age of source code over.

FAQ
How long did Qwen 3.8 27B take to identify the games?
Pac-Man took 46m 12s and 43,506 reasoning tokens, Pong 1h 4m 54s, and Breakout 52m 25s. The Freeway prompt failed.
What is Weight-Space Programming?
It is the paper's term for LLMs analyzing and modifying model weights directly through reasoning, without writing training loops.
Did the paper's findings go unchallenged?
No. spaCy author Matthew Honnibal called the paper misleading for conflating weight-reading with code-assisted model updates, and Sean Goedecke deconstructed the Qwen3.5-0.8B example as steps a human ML researcher would take.
Simon Willison's WeblogRead Original Article
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleNvidia's Holoscan platform lets AI agents steer Allen Telescope Array