Single cosmic ray bit-flip can completely disable LLM

The experiment emerged from a practical concern: as companies including those led by Elon Musk plan to place data centers in space, the radiation environment there—dominated by cosmic rays and stronger ambient radiation—will cause bit-flips far more frequently than at sea level. Standard protections like error-correcting code (ECC) memory exist, but the author's findings reveal how naked an unshielded LLM is: a single stray particle hitting the wrong bit can instantly render a 49-billion-parameter model useless.

The vulnerability concentrates in the exponent's most significant bit (MSB) of FP16 (16-bit floating point) weights. Flipping this bit can change a weight's magnitude by orders of magnitude—in the observed case, from 0.021 to 1352—disrupting the model's entire computation. The author's bisection-search approach efficiently found these critical bits by corrupting large blocks and narrowing down the fatal flip, avoiding the need to test millions of individual flips one at a time.

When the exponent MSB was artificially protected, the model's resilience improved dramatically, surviving tens of thousands to hundreds of thousands of flips before failure. However, the collapse was never graceful; the model typically entered loops where it would repeat the same tokens endlessly, occasionally triggered by damage to specific weights like token embeddings. The experiment did not test real ECC hardware or particle physics, only uniformly random bit flips as a simplified model, so the real-world severity depends on the exact radiation environment and shielding choices made by space data center operators.