AIToday
Large Language ModelsLatent SpacePublished: Nov 5, 2026, 06:01 JST

Frontier models write neural weights directly, Alex Krentsel replication shows 22× score

Send on LINE
Frontier models write neural weights directly, Alex Krentsel replication shows 22× score

3 Key Points

  1. What happened

    Several independent groups, including Alex Krentsel and Hugging Face's ML Intern reproduction, report that frontier models can build or edit small networks' weights directly, with the latest generating Breakout networks scoring up to 22× an RL-trained baseline.

  2. Why it matters

    If models can set network weights without gradient training or tools, the work suggests a new route to model improvement that is drawing independent replication, though some critics say the claims lack competent baselines.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The dispute over the weight-space programming story reflects how quickly a striking research result can move from a single paper to a contested claim. Several independent replications, including Alex Krentsel's cross-generation test and Hugging Face's reproduction with its ML Intern harness, have kept the finding alive even as critics challenge the baselines. The debate now centers less on whether models can touch weights directly and more on what that ability actually demonstrates.

Much of the skepticism targets interpretation rather than replication. Critics argue that fitting weights directly against a benchmark is essentially meaningless, and that at least one prominent result is better described as bug-fixing than as recursive self-improvement. Supporters frame the work as meta-learning finally working and suggest hybrids that interleave backprop with direct edits. The split matters because it determines whether the technique is treated as a new training paradigm or a narrow, benchmark-specific trick.

The surrounding release cycle adds pressure to sort this out quickly. Tencent's Hy4, Kimi K3.1 Pro's coming weights, and a wave of open-model launches give researchers more systems to test the weight-editing claim against. How the independent replications hold up under better baselines will likely decide whether weight-space programming becomes a standard tool or remains a provocative edge case.

FAQ
What does it mean to generate neural network weights directly?
Frontier models produced or edited the weights of small networks without gradient training or external tools, according to several independent replications.
Who has reproduced the weight-space programming result?
Alex Krentsel replicated MIT's experiment and saw a sharp capability jump across model generations; Hugging Face reproduced the paper with its ML Intern harness and released the model and a demo.
What are the main criticisms of the claims?
Critics say the big claims lack competent baselines, that fitting weights directly against a benchmark is essentially meaningless, and that one well-known result is bug-fixing rather than recursive self-improvement.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleGPT-6 Astra hits over 99% test correctness at $1