AIToday
Large Language ModelsImage GenerationTHE DECODERPublished: Nov 2, 2026, 01:00 JST

Adobe Research's EditAgent uses verification data to boost AI edit judging

Send on LINE
Adobe Research's EditAgent uses verification data to boost AI edit judging

3 Key Points

  1. What happened

    Adobe Research and UC San Diego built EditAgent, which uses an unmodified language model to pick the best edit from parallel variants using measured verification data; Qwen3.8-27B made a usable pick 81.3 percent of the time, beating EditScore-72B's 74.8 percent.

  2. Why it matters

    With verification records, all seven language models tested beat every fine-tuned model, suggesting what a judge model sees can matter more than how it was trained, which points to higher-quality automated editing checks.

WHO IT HITSCreative professionals and product teams building AI editing features, such as those at Adobe, face a trade-off where EditAgent needs about ten times the compute of a single editor but can produce usable results more reliably.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

EditAgent's approach contrasts with typical AI editing agents that retry the same general-purpose editor repeatedly and judge output by eyeballing. In a test of 600 image edits blind-rated by five professionals, the general-purpose editor Flux-2-Klein-9B failed to produce a usable result 42.7 percent of the time, while specialized tools solved roughly two-thirds of those failures, especially for sharpening, rotation, and zooming.

The researchers also found that iterative refinement piles up small errors, whereas professionals preferred parallel variants generated from the original in 78.5 percent of comparisons where they picked a side. EditAgent builds on both findings to avoid retrying the same editor and to use hard numbers for judging. It also checks whether later edits undo earlier ones, catching conflicts such as a "let in more daylight" instruction making a previously frosted window clear again.

Beyond editing, EditAgent serves as a data source: because it only keeps verified results, it produced about 26,000 training examples, and editors fine-tuned on that data performed better across three benchmarks, whereas training data generated directly by FLUX made FLUX worse. That tradeoff could make the agent's high compute costs worth it over time. Adobe's June addition of AI agents to Photoshop and other Creative Cloud apps as a public beta makes how well these agents pick tools and check their own output a directly relevant question for its shipping products.

FAQ
How does EditAgent work?
EditAgent plans a request in steps and for each step pits a general-purpose editor against specialized tools, generating multiple candidates in parallel. A standard language model then compares all variants in a single pass using verification records with close-ups, change maps, and measured brightness and color statistics.
What were the benchmark results?
On a 600-edit benchmark, Qwen3.8-27B made a usable pick 81.3 percent of the time, compared to 74.8 percent for the fine-tuned EditScore-72B. With verification data, all seven language models tested outperformed every fine-tuned model.
What are the limitations?
EditAgent needs about ten times as much compute as a single editor, and its performance depends on which specialized tools are plugged in.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleStellantis CTO Ned Curic: Make yourself redundant, even as we hire