Google DeepMind shows video generators solve computer vision tasks with minimal training data

Computer vision has historically fragmented into specialized models—separate architectures for segmentation, depth estimation, surface normals, and pose recognition—each optimized for its narrow task. The field has lacked the kind of unified training signal that made large language models so versatile; learning to predict the next word proved to be a powerful general-purpose objective that forced models to absorb grammar, world knowledge, and relationships. GenCeption suggests that video generation may serve a similar role for vision. Generating realistic video requires models to learn spatial geometry, object movement, and basic physics—representations that turn out to be useful far beyond video synthesis. By building on Alibaba's open-source Wan2.1 model and simplifying its architecture (replacing the iterative diffusion process with a single forward pass), the researchers demonstrate that these learned features can outperform task-specific systems trained on vastly more labeled data. The use of text prompts to specify which task to perform, combined with a unified output representation (all results expressed as standard three-channel RGB images), further echoes the instruction-following paradigm of large language models.

However, the claim that video generators contain a true "world model" remains contested. An international research team recently proposed a formal definition of world models and explicitly excluded text-to-video models from consideration, citing their lack of feedback from the real world. Yann LeCun, former Meta chief AI scientist, has argued that pixel-prediction video models are fundamentally limited, and a Tsinghua University benchmark showed that models like Sora 2, Seedance 2.0, and Veo 3.1 repeatedly failed basic physics and logic tests despite visually convincing output. GenCeption sidesteps this debate by using video generation for a narrower purpose—extracting learned features for specific tasks—rather than asking the model to predict how the world will behave. The results show that even without explicit physics understanding, the representations learned during video generation contain enough spatial and motion information to solve dense prediction tasks more efficiently than traditional approaches.