Engineer trains image AI on microcontroller with 264KB of RAM

Running AI models on severely memory-constrained hardware is typically thought to be impractical, yet this project demonstrates that even a 264KB microcontroller can host a trained diffusion model for image generation. The experiment reveals a fundamental hardware design lesson: adding raw compute power (the parallel MAC engines) did not improve overall performance because the system was bottlenecked by memory bandwidth, not CPU speed. The developer's choice to add FPGA acceleration actually degraded performance from ~70 seconds to ~220 seconds per image, a direct consequence of the high I/O overhead required to shuffle data in and out of the tiny SRAM. This trade-off is common in embedded AI: theoretically faster hardware can become slower when constrained by memory architecture. The heavy quantization and memory pressure did degrade image quality, producing noisy or distorted outputs, though some results were reportedly acceptable—suggesting that for certain edge-device applications, lossy quality might be an acceptable trade-off for the ability to run inference locally without cloud connectivity.