AIToday

NARE: A research prototype that routes LLM reasoning queries through a 4-layer cache and skill registry to reduce token costs and latency

Hacker NewsApr 28, 20262 min read
NARE: A research prototype that routes LLM reasoning queries through a 4-layer cache and skill registry to reduce token costs and latency

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. NARE pairs an LLM (Gemma-3-27B via Google Generative AI) with episodic memory and a skill registry, dispatching each query to one of four layers: an exact cache, a sandboxed Python skill (reflexive execution), delta-reasoning over a similar past episode, or a full Tree-of-Thoughts pass.

  2. The system compiles repeated reasoning patterns into executable Python skills during a sleep/REM consolidation loop, validated via AST (Abstract Syntax Tree) parsing, and gates skill promotion through confidence scoring and shadow verification.

  3. This is a research/engineering prototype without benchmarked results on standard reasoning tasks (HumanEval+, MATH, GSM8K, BIG-Bench Hard, AlfWorld, WebArena); the conceptual framings (Free-Energy, active-inference, Bayesian model reduction) are inspirations, not formal claims about the code's computation.

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →