
What happened
After publishing Qwen3-0.6B results yesterday, the same hand-built pipeline — bypassing an AI Hub export script bug — compiled, linked and profiled Llama 3.2 1B Instruct (w4a16, context 512) on a Dragonwing RB3 Gen 2 device, reporting 1,024 tok/s prefill and 16.4 tok/s decode.
Why it matters
One model passing through a workaround is an anecdote; two different model families doing so with no new surprises suggests a reusable method, and the measurements use the same per-graph profiling as the Qwen3 run so the two rows are comparable.
Summaries like this, every morning.
The two runs share more than a chip. The recipe was identical: read the pipeline's own compile parameters out of a failed export job, drop the single problematic flag, and pin the input shapes the script forgets to fix. That last step matters — the author notes the first Qwen3 attempt died because shapes were left dynamic. With six compiles, one link and six profiles on an RB3 Gen 2 all passing, the bug remains inside the script while the workaround routes around it.
What the author is really building is a series, not a single result. The comparison table now holds two rows at w4a16 and context 512: Qwen3-0.6B at 1,555 tok/s prefill and 24.6 tok/s decode, and Llama 3.2 1B Instruct at 1,024 and 16.4. The stated method is what makes the rows comparable, and the author says he would rather publish numbers bundled with their method than larger numbers without one. The next entries in the queue — Qwen3-1.7B and Llama 3.2 3B — would turn a two-point comparison into a trend, moving from extrapolation toward measured answers on what this chip runs and how fast.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
Nvidia reports Tuesday, the Fed releases October minutes Wednesday, and Anthropic expects to price its IPO Wed…

In a November 9 note, Evercore ISI's Amit Daryanani said Apple's integration across apps, personal data, and A…

ProAg moved one of its most complex legacy processes from .NET Framework 4.8 to .NET 8 on AWS EKS using AI age…

The explainer separates Claude Code extensions: MCP is the common standard connecting AI to external tools and…

Fujii built the app in a Muse 'Space', covering 4 junior high and 5 high schools in Tokushima, with reminders…

A free Zenn curriculum targets engineers who know basic C# syntax and walks them through building an inventory…
