Anthropic finds hidden "thought space" inside AI models

Anthropic's discovery of J-space represents a deeper probe into mechanistic interpretability—the study of why AI models produce specific outputs—a research focus the company has made central to its identity in ways other AI firms have not. The finding that models contain hidden internal representations that influence reasoning without appearing in output is genuinely novel and required developing new techniques to detect. However, the broader context matters: mechanistic interpretability research, while rigorous, is also controversial because describing AI behavior using terms borrowed from psychology and neuroscience can make models seem more sophisticated or intentional than they are. The use of "thoughts" and "consciousness" language risks anthropomorphizing systems that are, at their core, complex mathematical functions.

The practical safety application Anthropic proposes—using J-space monitoring to catch hidden misbehavior—is plausible in theory but remains speculative. The company's own framing, through a senior editor's interview, suggests this is better viewed as one incremental step toward understanding AI systems holistically rather than a standalone tool. This framing also reflects a narrative Anthropic has cultivated: positioning itself as the mysterious technology builder that also happens to be the best equipped to decode and control that mystery. The research genuinely advances knowledge of how these models work internally, but readers should distinguish between the technical contribution (mapping hidden internal structures) and the broader claims about what that contribution means for AI safety and control.