AIToday
Large Language ModelsZenn AI/MLPublished: Oct 23, 2026, 01:00 JST

Gemini 4 Argon fixes off-screen overlay drift in manual test

Send on LINE
Gemini 4 Argon fixes off-screen overlay drift in manual test

3 Key Points

  1. What happened

    Rerunning the same images and prompts that broke Gemini 3.5 Flash Lite, the developer found Gemini 4 Argon enclosed text boxes, dropdowns and confirmations at pixel-level accuracy, with no off-screen drift.

  2. Why it matters

    The result clears the main barrier that made AI-generated setup manuals impractical — coordinate errors — though the developer still saw font and label problems in the rendered PDF.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

The test is a direct sequel: the developer had previously run the same screenshots and prompts through Gemini 3.5 Flash Lite and watched a red box meant for the “新規追加” button land outside the screen. That failure pointed to weak pixel-level boundary detection, which made automated manual generation unreliable. This time, Gemini 4 Argon not only placed the boxes correctly but also invented a visual grammar the prompt never asked for — red solid lines for action points, yellow dashed lines for check points — suggesting the model is making document-level judgments, not just following coordinates. The remaining issues are of a different kind: simplified-Chinese-style glyphs in the PDF, banners drawn over input fields, and clipped text at fixed-width banner edges. According to the developer, these are downstream rendering artifacts that added prompt constraints could likely prevent, which would move the workflow from “fix the boxes by hand” to “tell the model how to draw.”

FAQ
What was the key difference between Gemini 3.5 Flash Lite and Gemini 4 Argon?
Gemini 3.5 Flash Lite misjudged pixel coordinates so badly that a red box meant for a button drifted below the screen. Gemini 4 Argon enclosed the same elements at pixel-level accuracy.
Did Gemini 4 Argon follow the prompt's overlay instructions?
It went beyond them: without any instruction to color-code, it defined a legend rule of red solid for actions and yellow dashed for checks, and drew lines accordingly.
What problems remained with the generated manual?
Some kanji glyphs looked like simplified Chinese font forms, annotation banners overlapped input fields, and long label text was clipped at the banner edge.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleAnthropic launches Claude Duet agent app for Pro and Max users