AIToday
Large Language ModelsTop Companies' AI MovesTop Companies AIPublished: Nov 23, 2026, 06:31 JST

Homelabber runs Kimi K3 on two RTX 3090s at 3.11 tokens per second

Send on LINE
Homelabber runs Kimi K3 on two RTX 3090s at 3.11 tokens per second

3 Key Points

  1. What happened

    A homelabber detailed a second-gen Optane build with two added RTX 3090s that runs the 2.8-trillion-parameter Moonshot Kimi K3 model at 3.11 tokens per second, in a follow-up post on Reddit.

  2. Why it matters

    This shows that a very large model can be run on a home-built setup, though the persistent Optane memory still gets very hot and extra fans are needed, according to the homelabber.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

This build is a follow-up to an earlier Optane-based AI setup, with the key change being the addition of two RTX 3090s. The homelabber shared the results in a Reddit post, showing that the 2.8-trillion-parameter Moonshot Kimi K3 model can run at 3.11 tokens per second on this home-built system. The use of a RAM drive to hold almost half the model is a notable tweak, yielding a 41% gain in generation speed and a 26% gain in prompt evaluation. However, the persistent Optane memory still runs very hot, so extra fans remain necessary, suggesting that cooling is an ongoing challenge for such dense setups.

FAQ
What performance improvement did the RAM drive add?
Transferring almost half the model onto a RAM drive added 41% to generation speed and 26% to prompt evaluation.
What cooling issue does the setup have?
The persistent Optane memory gets very hot, so extra fans are still needed.
Where was this build detailed?
In a follow-up post on Reddit by a homelabber.
Top Companies AIRead Original Article
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleSMART-TD raises monthly health contribution $40.86 in 2027