Researchers discover that LLMs represent concepts geometrically rather than linguistically, with identical concepts converging across 8 languages and 4 models including code and math.

Experiments across 4 models (Qwen3.5-27B, MiniMax M2.5, GLM-4.7, GPT-OSS-120B) show consistent geometric representation of concepts in middle layers

Tested across 8 languages (English, Chinese, Arabic, Russian, Japanese, Korean, Hindi, French) - language identity essentially disappears in model's internal representations

Same concept expressed three ways (English description, Python code, LaTeX equation) converge to the same region in the model's representation space, suggesting unified geometric encoding rather than language-dependent thinking