AIToday
AI Business & Industryr/MachineLearningPublished: Oct 30, 2026, 06:00 JST

K5 ternary format beats FP8: 3.21× prefill on Qwen2.5-0.5B

Send on LINE
K5 ternary format beats FP8: 3.21× prefill on Qwen2.5-0.5B

On Qwen2.5-0.5B-Instruct with a fixed matched workload, TKintegers K5 reached 3,402.85 tokens/s prefill and 26.75 tokens/s decode, versus TorchAO dynamic E4M3 FP8 at 1,061.58 and 8.63.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

r/MachineLearningRead Original Article
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleOpenAI-backed Thrive Holdings buys ADT in $15.3 billion deal