AIToday

Subquadratic releases SubQ 1M-Preview, an LLM with subquadratic architecture that reduces attention compute by almost 1,000x compared to other frontier models

Exponential IndustryMay 10, 20262 min read
Subquadratic releases SubQ 1M-Preview, an LLM with subquadratic architecture that reduces attention compute by almost 1,000x compared to other frontier models

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. Subquadratic, an AI company, launched SubQ 1M-Preview, the first LLM built on a fully subquadratic architecture where compute grows linearly rather than quadratically with context length. The model achieved a research result at 12 million tokens.

  2. SubQ is available via three interfaces: an API for developers and enterprise teams; SubQ Code, a coding agent that loads entire codebases into a single context window via command line interface; and SubQ Search, a long-context search tool providing Deep Research capabilities.

  3. The subquadratic architecture reduces attention compute by almost 1,000x compared to other frontier models, addressing a fundamental limitation of transformer-based LLMs where compute requirements scale quadratically with context length.

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →