AIToday
Large Language ModelsHacker NewsPublished: Jul 29, 2026, 01:00 JST

Exabase hits top BEAM memory benchmark with smaller, efficient model

Exabase hits top BEAM memory benchmark with smaller, efficient model

3 Key Points

  1. What happened

    Exabase's M-1 system scored 76.9% at 100K tokens, 75.0% at 1M tokens, and 68.0% at 10M tokens on BEAM, the hardest AI memory benchmark. It outperformed previous leaders Hindsight (73.4%, 73.9%, 64.1%) and Honcho (63.0%, 63.1%, 40.6%), while using Google's smaller Gemini 3 Flash instead of the larger Gemini 3 Pro that prior winners relied on.

  2. Why it matters

    At 10M tokens—vaguely equivalent to a year of long daily chats with an LLM—genuine recall becomes the only path to high scores, since context stuffing fails at that scale. M-1's win on the largest-scale benchmark suggests the system has developed real memory capabilities, not just brute-force model size. The efficiency gain (about 20% fewer tokens per query than the next best system) means better recall at lower computational cost.

  3. What to watch

    M-1 now holds state-of-the-art on both major memory benchmarks (BEAM and LongMemEval) at every scale from 115K to 10M tokens. The system shows specific weaknesses—multi-session reasoning collapsed to 9.6% at 10M tokens—which the team plans to address. Full methodology and results are published in a research paper at exabase.io.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, in your inbox every morning.

Context & Analysis

BEAM represents a fundamentally harder test than earlier memory benchmarks because its 10M token scale exceeds any single model's context window, eliminating the shortcut of context stuffing. Previous benchmarks allowed systems to cheat by fitting the entire corpus in a window; at 10M tokens, only about half of a large window can be effectively utilized without degradation. This forces M-1 to rely on genuine recall mechanisms rather than model size or brute-force retrieval.

The competitive gap between M-1 and prior leaders widens as scale increases. At 100K tokens, M-1 leads Hindsight by 3.5 percentage points; at 10M tokens, the gap grows to 3.9 points. Against Honcho, the lead expands from 13.9 points to 27.4 points. This pattern suggests that larger corpora increasingly filter out systems that rely on capability rather than genuine recall, highlighting M-1's architectural strength at scale.

M-1's efficiency—consuming about 20% fewer tokens per query—combined with its use of the smaller Gemini 3 Flash model (versus Gemini 3 Pro for prior winners) indicates that effective memory design can outperform both larger models and higher computational budgets. The system's state-of-the-art status across both BEAM and LongMemEval at all scales suggests the approach generalizes.

FAQ
What is BEAM and why does it matter?
BEAM tests ten memory abilities including contradiction resolution, event ordering, and instruction following. At 10M tokens, the scale is vastly larger than any model's context window, making it the hardest test of genuine recall; previous benchmarks allowed context stuffing, which BEAM at this scale does not.
How does M-1 differ from previous winners?
M-1 uses Google's smaller Gemini 3 Flash model, whereas Hindsight and Honcho (the prior leaders) both relied on the larger Gemini 3 Pro. M-1 also consumed about 20% fewer tokens per query than the next best system.
Where does M-1 struggle?
M-1 shows weakness in multi-session reasoning, scoring 44.7% at 100K tokens and collapsing to 9.6% at 10M tokens, though the team notes this challenge appears widespread across memory systems at this scale.

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleSnowflake launches Cortex AI Gateway, beefs up AI security at Black Hat 2026