AIToday

Despite theoretical capacity, large language models exhibit human-like working memory limitations that worsen under cognitive load.

arXiv cs.LGApr 14, 20261 min read
Despite theoretical capacity, large language models exhibit human-like working memory limitations that worsen under cognitive load.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. Pretrained LLMs struggle with working memory tasks despite transformers having full attention access to prior context, unlike simpler two-layer transformers that master these tasks perfectly

  2. LLMs reproduce specific human working memory interference patterns: performance degrades with increased memory load and is biased by recency and stimulus statistics

  3. Research across multiple models shows a correlation between stronger working memory capacity and broader overall competence, suggesting this is a fundamental limitation affecting AI reasoning

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →