
What happened
In a write-up on Zenn, a developer used the TLA+-family language Quint to state one rule — tickets sold never exceed initial stock — and model-checked a ticket-sales design. Quint found an oversell violation in 12ms, after the AI-written implementation and its 3 AI-written tests all passed.
Why it matters
An AI writing both code and tests grades its own homework — the author's "self-scored perfect" — since the tests only cover scenarios the same model imagined; keeping the rule-making human while machines generate the cases is his proposed division of labor.
Summaries like this, every morning.
The piece is a practitioner's walkthrough rather than a product announcement, and its structure is a single worked example. A ticket service is specified in Quint with three users and two tickets; the invariant noOversell states that sold never exceeds the initial stock. The AI-written implementation passed its own three tests, then failed 578 of 1,000 randomly generated traces — a gap the author attributes to the same model having invented both the code and the scenarios it was checked against.
The author places this in the long-standing Test Oracle Problem: tests need both an input and a way to judge the result correct, and the judgment is the hard part. His examples of weak substitutes are concrete — a multi-agent adversarial review once returned 47 nitpicks while missing the real bug, which he likens to a classmate from the same cram school writing the exam. TLA+, created by Turing Award winner Leslie Lamport, and AWS's reported use of it on S3 and DynamoDB designs supply the pedigree; Quint is presented as the approachable, TypeScript-like syntax with the same TLC checker underneath.
The conclusion is deliberately scoped. Test cases do not disappear, the author says — they remain fast, readable "living documentation" for simple screens. Rules are for the places where concurrency, money, inventory or permissions make exhaustive human enumeration impractical, and the suggested starting posture is to write them only where interruption bugs feel frightening.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.