Google DeepMind's DiffusionGemma shows high interpretability despite complex reasoning steps

Researchers tested Google DeepMind's DiffusionGemma model, which generates text through multiple diffusion steps that produce both tokens and vectors. They found that projecting these vectors to their single highest-ranked item maintains strong performance, suggesting the model remains interpretable even during its reasoning process.