
What happened
A Zenn author examined IQuestLab's IQuest-Q1 — a 320B sparse MoE model with a 524,288-token context — but skipped live inference: BF16 weights are about 650GB and the official vLLM/SGLang recipe assumes 8 GPUs (--tp-size 8).
Why it matters
The blocker was a physical constraint, not the paperwork — the model's distribution and terms were checked at the file level even though the weights never ran.
Summaries like this, every morning.
The piece is deliberately framed as a partial-verification exercise. Because the model's size put live inference out of reach — BF16 weights at roughly 650GB and an official deployment recipe assuming 8 GPUs via vLLM/SGLang — the author drew an explicit line: nothing that was not actually run would be described as run. That stance shapes what the piece does and does not cover.
What remained verifiable was checked at the file level. The benchmark table is quoted from the paper rather than reproduced, and the author states directly that those are the authors' own reported figures. The release's config.json was confirmed to match the architecture description, and the tokenizer was downloaded and exercised on sample text.
One minor discrepancy surfaced along the way: the tokenizer vocabulary still contains image and video placeholder tokens, even though the model is documented as text-input only. The author calls this a residual rather than a practical problem, but notes it as a small gap between how the model is described and what the vocabulary actually contains.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
Booking.com is now having AI answer traveller questions ahead of the guest's arrival, a shift Hospitality Net…

At the PRovoke Global Summit, McDonald's discussed rethinking its PR strategy in response to AI reshaping earn…

FANUC and Microsoft are linking factory-floor data with business data through Copilot, Microsoft's AI assistan…

Renesas Electronics is building a foundation to design semiconductors with AI agents, aiming to use AI-based d…

SoftBank will offer AGENTIC STAR 3.0 from October 26, 2026, adding a project feature that designs and manages…

Hina Shamsi, CIO of wealth management technology at Morgan Stanley, said the division's AI has evolved from co…
