Cognition has Devin test its own work with GPT-6 Astra

Cognition's Devin is an autonomous software engineer used by businesses ranging from big banks to tech-native startups. As Cognition's own engineering teams write more code, reviewing that output has become a challenge, and the company is pointing to GPT-6 Astra's testing ability as the way to make that review more efficient.

The move is not limited to Devin. Cognition says it is applying GPT-6 Astra across its product lineup, including the core cloud agent Devin, its CLI and its desktop products. One illustration: Devin used Astra to test Otter Run, an iPhone game, returning a recording of the game running in a simulator alongside a report identifying checks that passed and areas left untested. The recording shows how the application behaves, while the report documents the scope of the testing, so engineers can inspect the software and see what still needs attention. Astra is also helping Cognition get back to customers faster, according to co-founder Walden Yan: when a customer sends a screenshot of a bug, the team can pass it to Devin using Astra, which fixes the issue and returns a screenshot showing the result.

What the outcome hinges on is whether Devin's testing evidence actually cuts the manual examination engineers do. Yan frames this as an expectation rather than a measured result, saying the company expects to manually look at less code over time and ship more. For engineering teams using Devin, the practical test is likely whether those recordings and reports are enough to trust a change without reading the code line by line.