18-year-old developer successfully trains 1.088B-parameter Spiking Neural Network from scratch, achieving 93% sparsity and unexpected cross-lingual capabilities before funding ran out.

An indie developer trained a pure SNN to 1.088B parameters directly from random initialization, contradicting prior research that deemed it impossible due to vanishing gradients

The model maintained 93% sparsity with only 7% of neurons firing per token, resulting in significantly reduced memory requirements during inference

At step 25,000, the model spontaneously began generating structurally correct Russian text despite no explicit multilingual training or weighting

Training was halted at 27,000 steps due to budget exhaustion, but achieved a loss convergence of 4.4

The model demonstrated spontaneous architectural shifts in memory routing patterns when scaled from 600M to 1B parameters